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(57)Abstract: 

PROBLEM TO BE SOLVED: To lighten the burden on 
the operation and to utilize usable optimum device 
resources by recognizing the state of received 
information and quitting executing a process when it is 
judged from the analysis result and state that the 
process should not be executed. 

SOLUTION: If a printer 104 is defective in, for example, 
printing operation when the user of a PC 101 gives a 
JOB for outputting information inputted through a 
scanner 102 to the printer 104, it is judged that the 
printer 104 is usable to perform the given JOB and a 
printer 103 is able to perform the JOB for outputting the 
information, so it is decided that the received 
information is sent to the printer 103. Consequently, the 
printer judges that the JOB is performed not by itself, 
but by the printer 103, and indicates the JOB to the 
printer 103. The PC 101 of the user having indicated the 
JOB is informed by electronic mail that the indicated 
output is done by the printer 103. 
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CLAIMS 

[Claim(s)] 

[Claim 1] A receiving means to receive information, an analysis means to analyze the received 
information, and a decision means to opt for the processing which should be performed based on 
the analysis result of this analysis means, An activation means to perform said processing for 
which it opted, and a recognition means to recognize a situation, A decision means to judge 
whether said processing should be performed with said activation means based on said analysis 
result and said situation, The information processor characterized by having a termination means 
to stop activation of said processing by said activation means when [ which should be performed 
with this decision means ] it is judged that it does not come out. 

[Claim 2] The information processor according to claim 1 characterized by having a directions 
means to direct activation of said processing to other equipments. 

[Claim 3] The information processor according to claim 2 characterized by having an advice 
means to notify a user of having directed activation of said processing to equipment besides the 
above. 

[Claim 4] Said situation is an information processor according to claim 1 characterized by 
including the own situation of equipment 

[Claim 5] Said situation is an information processor according to claim 1 characterized by 
including the situation of other equipments. 

[Claim 6] Said situation is an information processor according to claim 1 characterized by 
including a user's situation. 

[Claim 7] The information processor according to claim 1 characterized by stopping activation of 
the processing concerned when the processing for which it opted with said decision means is the 
processing unnecessary for a user recognized by said recognition means. 

[Claim 8] The information processor according to claim 1 characterized by stopping activation of 
the processing concerned when the processing for which it opted with said decision means is the 
processing which is not permitted for the user recognized by said recognition means. 
[Claim 9] The information processor according to claim 1 with which processing for which it 
opted with said decision means is characterized by stopping activation of the processing 
concerned when the user recognized by said recognition means is processing for a different 
user. 

[Claim 10] said decision means should perform said processing with other equipments rather 
than said activation means — ** — when it judges, it should perform with said activation means 

— not coming out — judging — said directions means — activation of said processing — said - 

- others — the information processor according to claim 2 characterized by what is directed to 
equipment. 

[Claim 11] The information processor according to claim 1 characterized by having an advice 
decision means to judge whether a user is notified of the processing concerned in advance of 
activation of said processing, based on said analysis result 

[Claim 12] the case where activation of said processing is directed to other equipments — being 
concerned — others — the information processor according to claim 2 which will be 
characterized by rerunning decision by said decision means if directions are refused from 



equipment. 

[Claim 13] It is the information processor according to claim 2 characterized by to direct 
activation of said processing to other equipments when it is judged that it is appropriate to have 
an equipment decision means to judge whether it is appropriate to recognize the situation of 
equipment itself and other equipments with said recognition means, and to perform with which 
equipment from the recognized situation, and to perform with other equipments. 
[Claim 14] The information processor according to claim 13 characterized by having a proposal 
means to form an alternative and to propose to a user when activation by which equipment is 
also judged not to be suitable by said equipment decision means. 

[Claim 15] The receiving process which receives information, the analysis process which 
analyzes the received information, and the decision process which opts for the processing which 
should be performed based on the analysis result of this analysis process, The activation 
process which performs said processing for which it opted, and the recognition process which 
recognizes a situation, The decision process which judges whether said processing should be 
performed according to said activation process based on said analysis result and said situation, 
The information processing approach characterized by having the termination process which 
stops activation of said processing by said activation process when [ which should be performed 
according to this decision process ] it is judged that it does not come out. 
[Claim 16] The information processing approach according to claim 15 characterized by having 
the directions process which directs activation of said processing to other equipments. 
[Claim 17] The information processing approach according to claim 16 characterized by having 
the advice process which notifies a user of having directed activation of said processing to 
equipment besides the above. 

[Claim 18] Said situation is the information processing approach according to claim 15 
characterized by including the own situation of equipment. 

[Claim 19] Said situation is the information processing approach according to claim 15 
characterized by including the situation of other equipments. 

[Claim 20] Said situation is the information processing approach according to claim 15 
characterized by including a user s situation. 

[Claim 21] The information processing approach according to claim 15 characterized by stopping 
activation of the processing concerned when the processing for which it opted according to said 
decision process is the processing unnecessary for a user recognized according to said 
recognition process. 

[Claim 22] The information processing approach according to claim 15 characterized by stopping 
activation of the processing concerned when the processing for which it opted according to said 
decision process is the processing which is not permitted for the user recognized according to 
said recognition process. 

[Claim 23] The information processing approach according to claim 15 that processing for which 
it opted according to said decision process is characterized by stopping activation of the 
processing concerned when the user recognized according to said recognition process is 
processing for a different user. 

[Claim 24] in said decision process, said processing should be performed with other equipments 
rather than said activation process — ** — the information processing approach according to 
claim 15 which judges that it does not come out and is characterized by the thing which should 
perform according to said activation process, and for which activation of said processing is 
directed to other equipments at said directions process when it judges. 
[Claim 25] The information processing approach according to claim 15 characterized by the 
advice decision process of judging whether a user being notified of the processing concerned in 
advance of activation of said processing based on said analysis result. 

[Claim 26] the case where activation of said processing is directed to other equipments — being 
concerned — others — the information processing approach according to claim 16 which will be 
characterized by rerunning decision by said decision means if directions are refused from 
equipment. 

[Claim 27] It is the information-processing approach according to claim 24 characterized by to 



direct activation of said processing to other equipments when it is judged that it is appropriate 
to have the equipment decision process of judging whether it being appropriate recognizing the 
situation of equipment itself and other equipments according to said recognition process, and 
performing with which equipment from the recognized situation, and to perform with other 
equipments. 

[Claim 28] The information processing approach according to claim 27 characterized by having 
the proposal process which forms an alternative and is proposed to a user when activation by 
which equipment is also judged not to be suitable according to said equipment decision process. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the information processing system to which two 

or more equipments were connected, and its approach. 

[0002] 

[Description of the Prior Art] In order to perform various processings in an environment with two 
or more available equipments, the equipment with which the user was suitable for each 
processing is chosen, and it is common to order activation of the processing corresponding to 
selected equipment 

[0003] For example, in order to transmit the information created by computer, and the 
information read with the scanner in the form recorded on the distant partner by paper, the 
partners printer connected through a network etc. can be specified, and it can print by the 
specified printer. 
[0004] 

[Problem(s) to be Solved by the Invention] However, in the above-mentioned Prior art, 
processing a certain directed equipment was instructed to be by failure, poor ability, etc. was not 
completed at all, or when it was not able to do thoroughly, there was a problem that the 
processing the equipment was ordered to perform could not attain as a user s object In order to 
have solved this, the user needed to check the processing result and needed to order other 
equipments anew to perform the same processing or additional processing. 
[0005] Moreover, in order to attain the object of processing, even if there was equipment more 
suitable than the equipment which the user directed, it has processed only with the equipment 
which the user directed. 

[0006] Moreover, it may be processing for a specific user depending on processing, and may be 
unnecessary or unsuitable to a current user. 

[0007] The object of this invention can solve such a conventional technical problem, can mitigate 
the burden of actuation of the user for attaining the object of processing, can utilize the optimal 
available device resource, and is to offer the information processing system which can avoid 
unnecessary or unsuitable processing, and its approach. 
[0008] 

[Means for Solving the Problem] A receiving means to receive information to an information 
processor according to this invention in order to solve the above-mentioned technical problem, 
An analysis means to analyze the received information, and a decision means to opt for the 
processing which should be performed based on the analysis result of this analysis means, An 
activation means to perform said processing for which it opted, and a recognition means to 
recognize a situation, It has a decision means to judge whether said processing should be 
performed with said activation means based on said analysis result and said situation, and a 
termination means to stop activation of said processing by said activation means when [ which 
should be performed with this decision means ] it is judged that it does not come out 
[0009] Moreover, the receiving process which receives information to the information processing 
approach according to other modes of this invention, The analysis process which analyzes the 



received information, and the decision process which opts for the processing which should be 
performed based on the analysis result of this analysis process, The activation process which 
performs said processing for which it opted, and the recognition process which recognizes a 
situation, It has the decision process which judges whether said processing should be performed 
according to said activation process based on said analysis result and said situation, and the 
termination process which stops activation of said processing by said activation process when 
[ which should be performed according to this decision process ] it is judged that it does not 
come out. 
[0010] 

[Embodiment of the Invention] 

[Operation gestalt 1] Drawing 1 is system configuration drawing of this operation gestalt, and 
expresses two or more equipments connected to the network. In this, in a personal computer 
(PC) and 102, a scanner and 103 express a color printer and, as for 101, 104 expresses the 
monochrome printer. 

[001 1] With this operation gestalt, in the system (when it is drawing 1 , it connects with the 
network) to which two or more equipments were connected, when activation of JOB is directed 
to a certain equipment, he understands what JOB which should analyze the object and he should 
perform from the content of JOB is. As a result of understanding, information required for JOB 
which should be performed is acquired and performed. In case JOB is performed, when there are 
technique more effective than the directed content and another equipment, processing is 
directed to other equipments or advice for proposing the technique to a user is performed. 
[001 2] Moreover, it also performs refusing the directions itself depending on the content of JOB. 
Here, there is new JOB generated by itself at the activation directions from a users alter 
operation and other devices, the result of having analyzed these JOB(s), and the time of an idling 
in the class of JOB. For example, in printing a document by another printer as reading from a 
scanner, the following JOB(s) occur. 

** The read and analysis processing of a document in which the analysis ** scanner of the 
content of the directions to a scanner analyzed and generated the directions (and thing for 
which the document was set) received from the user about the document which the user set to 
the scanner, The directions processing ** scanner to the printer for printing the read document 
generated according to directions processing, the printing processing whose printing directions 
** printer to a printer analyzed and generated the printing directions received from the scanner 
— the detail of such a generation management method of JOB is explained henceforth [ the 
operation gestalt 1 1 ]. 

[0013] Below, the procedure of performing these processings with two or more equipments is 
concretely explained based on a drawing. 

[0014] Drawing 2 is a functional block diagram for processing this operation gestalt The JOB 
receipt section 201 receives JOB from a user or other equipments. Received JOB is registered 
into the JOB table 202. The JOB analysis section 203 takes out and analyzes JOB registered 
into the JOB table 202. The other devices information acquisition section 204 acquires an 
attribute, a current condition, etc. of other connected devices. The situation seal step 207 
judges a situation from the current condition of other devices etc. 

[0015] The optimal planning section 210 stands the optimal plan about activation of JOB. In the 
JOB activation decision section 206, when performing whether JOB is performed or not, it 
judges performing by other devices whether it performs with self-equipment etc. When 
performing by other devices, activation of JOB is directed to other devices by the directions 
section 205 to other devices. When performing with self-equipment, it performs in the JOB 
activation section 209. The advice section 211 of activation notifies a user of having directed 
activation to an activation result or other devices etc. 

[0016] Drawing 3 is hardware configuration drawing of each equipment for realizing processing of 
this operation gestalt. 

[0017] I/O301 performs I/O with the equipment exterior. CPU302 controls each part of 
equipment while performing a program. ROM303 memorizes a program, fixed data, etc. which 
should perform CPU302 corresponding to each flow chart mentioned later. RAM304 memorizes 



temporarily various variables generated during activation of processing, such as an attribute, a 
current condition, etc. of the JOB table 202 and other devices by which it acquired in the other 
devices information acquisition section 204 T medium data, etc. Moreover, a program is loaded to 
RAM304 from the equipment exterior etc., arid you may make it make it memorize. 
[0018] Drawing 4 is the flow chart which showed the flow of processing of this operation gestalt. 
First, the content of the JOB table is initialized at step S109. At step S1 10, it judges whether 
JOB was inputted by confirming whether there is new JOB generated by itself at the input JOB 
from the input JOB from a user, the device which can detect a system, the result of having 
analyzed these JOB(s), and the time of an idling. If inputted, JOB inputted into the JOB table will 
be added at step S1 1 1. If it investigates whether there is JOB on a JOB table and is shown in it 
at step S112, JOB will be taken out at step S113. At step S114, the given directions are 
analyzed and the object of JOB is analyzed from the information. At step S1 1 5, JOB which 
should be performed further is probed from the analyzed directions. At step S116, JOB probed 
at step S115 is registered. 

[001 9] At step S1 1 7, it investigates whether there is non-performed JOB, and if it is, it will 
progress to step S118. At step S1 18, when JOB judges whether activation is possible and is 
judged to be impossible, return and JOB which must newly be performed are probed to step 
S115. At step S119, JOB is performed and it returns to step S117. 

[0020] For example, it will be analyzed, if it is a user's object that a document [ finishing / 
printing ] comes to hand when a user gives directions so that a document may be printed by 
another printer as reading from a scanner. Moreover, the read and analysis processing of a 
document in which the scanner analyzed and generated the information received from the user, 
and the directions processing to the printer for printing the read document are probed as JOB in 
this case. Explanation of such detailed flow is explained henceforth [ the operation gestalt 1 1 ] 
based on an example. 

[0021] Drawing 5 is drawing having shown the flow of the processing which chooses the optimal 
printer from two or more printers, and performs printing. 

[0022] In drawing 5 , the instruction from a host computer, an instruction of the natural language 
which the user as directions from remote control etc. emitted with voice, and the bar code or 
text read in the cover page is analyzed, and JOB information is transmitted and inputted. 
[0023] The device which received the transmitted JOB information analyzes JOB, outputs by 
choosing automatically the printer which can perform processing suitable for JOB, and when 
there are advice directions further, it chooses and notifies the optimal media according to an 
advice place. Therefore, to a demand of a user, with reference to the configuration of a printer, a 
suitable printer is chosen and printing is performed. According to a situation, it also performs 
distributing processing to two or more printers in that case. Moreover, when there are advice 
directions, the optimal media for advice are chosen and the printer name which performed 
printing, termination of printing, etc. are notified. As a demand of a user, there are a paper size, a 
quality of printed character, a color, a time limit (for example, I want to print by 5:00), etc. 
Moreover, as a configuration of a printer, there are a class of printer, the number, the engine 
performance, a current condition (normal actuation is carried out, there is a queue of the waiting 
for printing, or forms and toners are insufficient), etc. As media for advice, a user's terminal, 
voice reports, tell by telephone, a message is sent to a pocket bell, or it transmits by the 
electronic mail or FAX by using the content of advice as a document. 
[0024] Below, according to the flow chart of drawing 4 , the situation that each equipment 
processes processing of drawing 5 is explained. 

[0025] First, when the directions which are step S110, for example, are urgent and will output a 
certain document by 5:00 to a host computer are able to be given, JOB is added to a JOB table 
at step S1 1 1. At step S1 13, the directions to which JOB was given at ejection and step S1 1 4 
are analyzed, and the object of JOB is analyzed from the information. At step S115, following 
JOB is probed from the analyzed directions. 

[0026] ** Acquire the information (a paper size, a quality of printed character, color document, 
etc.) for choosing the printer suitable for an output from the document which should be 
outputted, and information, such as the time limit 



** Choose the printer suitable for the information on ** from the connected printer. 

** Inspect whether the selected printer has a failure in an output 

** Output to the printer chosen automatically. 

** Notify having performed the selected printer and the output 

[0027] At step S1 16, JOB probed at step S115 is registered. The following is repeated until it is 
judged that ail probed JOB(s) were lost at step S117. At step S118, when JOB judges whether 
activation is possible and is judged to be impossible, JOB which must newly be performed is 
probed. At step S119, probed JOB is performed in order. 

[0028] [Operation gestalt 2] Drawing 6 is drawing which explains the case where a remote 
controller (remote control) is used, as an approach of directing to various devices. 
[0029] This remote control 605 is equipped with a display, only approaches devices, such as 
printers 601 and 602, and FAX603, PC604, can display the control panel and information 
corresponding to that device, and can give and control directions to that device. Furthermore, 
the device which is distantly separated from the device near the remote control 605 through a 
network is also controllable. 

[0030] Moreover, the monitor of the status of each device can be carried out, and remote 
control 605 can display it and can also acquire the status of the device on a network which 
separated distantly through the device near the remote control 605. 

[0031] [Operation gestalt 3] Drawing 7 is drawing showing the example at the time of reading a 
document from a scanner and transmitting to a specific printer. 

[0032] After a document is read from a scanner 701, a user specifies a transmission place (using 
voice etc.). Or the transmission place is specified as the cover page and a transmission place is 
determined automatically. Thus, when it is in the condition which cannot print a transmission 
place as a transmission place as a result of acquiring the condition of ** transmission place after 
the monochrome printer A702 is determined, it transmits to another printer (for example, 
monochrome printer B703) automatically, and prints. 

** When the printer specified as a transmission place cannot print (from conditions, such as a 
color and a paper size), transmit only the page to other printers (for example, if it is a color color 
printer C704). 

** In the case of the document of large quantity pagination, print by dividing into some printers. 
** When the destination is specified as the transmission place, transmit to the destination 
automatically. 

[0033] [Operation gestalt 4] Drawing 8 is drawing showing the example at the time of 
transmitting to the specific printer which reads a document from a scanner and cannot manage a 
scanner (by reasons of network domains differing). 

[0034] After a document is read from the scanner 701 in Austin, a user specifies a transmission 
place (using voice etc.). Or the transmission place is indicated by the cover page by the 
character string or the bar code, it is read, and a transmission place is automatically determined 
by recognition and interpreting. Thus, after the monochrome printer A702 which is in Tokyo as a 
transmission place is determined and a document is actually sent to the monochrome printer 
A702, in the case of the condition which ** monochrome printer A702 cannot print by itself, it 
transmits to another printer (monochrome printer B703), and prints. 

** When the monochrome printer A702 cannot print the document received (from conditions, like 
that a color page is included and paper sizes differ), transmit only the received whole document 
or the page which cannot be printed to other printers (for example, if it is a color color printer 
C704). 

** While the monochrome printer A702 prints by itself in the case of the document of large 
quantity pagination, print by dividing into other printers. 

** The monochrome printer A702 transmits to the destination automatically, when the 
destination is specified as itself. 

[0035] The point of difference between the operation gestalt 3 and the operation gestalt 4 has 
the printer 702 which received the document from the scanner 701 in the point of determining 
the destination, by the operation gestalt 4 to the scanner 701 having determined the 
transmission place with the operation gestalt 3. 



[0036] [Operation gestalt 5] Drawing 9 is drawing showing the example at the time of 
transmitting to the specific printer which reads a document from a scanner and cannot manage a 
scanner for the reasons of network domains differing. 

[0037] After a document is read from the scanner 701 in Austin, a user specifies a transmission 
place (using voice, a keyboard, etc.). Or the transmission place is indicated by the cover page by 
the character string or the bar code, it is read, and a transmission place is automatically 
determined by recognition and interpreting. Thus, after the monochrome printer A702 which is in 
Tokyo as a transmission place was determined and a document is actually sent to the 
monochrome printer A702, it is transmitted to the personal computer 705 in which more 
advanced processing is possible. Consequently, a personal computer 705 judges that this 
document is an urgent document (from the alphabetic character a covering letter "is urgent"), 
and if schedule data etc. show where the reception hand of a document is now, it will transmit it 
to that location (for example, Atsugi). the destination is not a printer but FAX D706 in that case 
— etc. — if media differ, media conversion will be performed and it will transmit 
[0038] [Operation gestalt 6] Drawing 10 is drawing showing the example at the time of 
transmitting to the specific printer which reads a document from a scanner and cannot manage a 
scanner for the reasons of network domains differing. 

[0039] After a document is read from the scanner 701 in Austin, a user specifies a transmission 
place (using voice etc.). Or the transmission place is indicated by the cover page by the 
character string or the bar code, it is read, and a transmission place is automatically determined 
by recognition and interpreting. Thus, after the monochrome printer A702 which is in Tokyo as a 
transmission place was determined and a document is actually sent to a printer A702, it is 
transmitted to the personal computer 705 in which more advanced processing is possible. 
Consequently, a personal computer 705 can recognize the reception hand of a document, can 
create an advice sentence, and can notify arrival of a document to the reception hand of a 
document by telephone 707. 

[0040] [Operation gestalt 7] Drawing 1 1 is drawing showing the example in the case of notifying 
the condition of a printer. 

[0041] If PC1102 acquires the status of a printer 1 103 through a network and change of the 
status, such as an error and generating of an event, is detected, according to the content, it will 
determine advice places, such as a user or a manager, and will notify using the media 
corresponding to the determined advice place. For example, notify to the terminal 1 101 of a user 
or a manager by E-mail, a telephone 1 104 is contacted by phone, or a message is transmitted to 
a pocket bell 1105. 

[0042] Thereby, in the example of drawing 10 , it may replace with a telephone 707 and an 
electronic mail and a pocket bell may notify reception of a document 

[0043] [Operation gestalt 8] With this operation gestalt, when the equipment to which JOB was 
directed performs JOB by itself, it does not carry out as it is, but before performing the content 
of JOB, depending on the class and conditions of JOB, it notifies and checks at a user, or it 
cancels JOB judged to be unnecessary for a user. 

[0044] Drawing 1 27 is the information which specified whether an advance notification would be 

performed corresponding to the class and conditions of JOB. 

[0045] Drawing 12 is a flow chart showing the procedure of this operation gestalt 

[0046] First, before performing directed JOB at step S120, it judges in analyzing the content 

indicated that the assignment information on the advance notification corresponding to the class 

and conditions of JOB of drawing 127 in whether a user should be notified of the processing to 

perform or the content is referred to, or the operation gestalt 29 explains by the cover page etc. 

When notifying in advance, the processing and the content which progress to step S122 from 

step S121, and are performed are notified. Furthermore, if there is need at step S123, after 

getting authorization of activation from a user, JOB will be performed at step S124. 

[0047] On the other hand, when not notifying in advance, it judges whether it is step S125 and is 

required JOB for a user, if required, JOB will be performed at step S127, but if unnecessary, 

JOB will be canceled at step S128. 

[0048] Next, when the content of JOB is informational filing, before a system performs 



informational filing, the content is analyzed, and the example which performs processing which 
tells a user the content is explained. 

[0049] Drawin g 13 is filing processing and is drawing showing the case where the information to 
file is told to a user in advance. As for a file storage unit and 1302, 1301 is [ a scanner and 
1303 ] user terminals. 

[0050] Processing of the scanner 1302 in drawing 13 is explained according to the flow chart of 
drawin g 1212 . 

[0051] At step S120, since it is JOB which files information, with reference to the assignment 
information on drawing 127 , it judges that the information filed before filing is notified, and 
information is scanned. Processing is passed to step S122 in order to notify the information to 
file at step S121. At step S122, the scanned information is notified to a user terminal 1303 
through a network. JOB of filing is performed at step S124. 

[0052] Next, when the 1st sheet is received and the content is analyzed, when there is receipt 
information, and judged as the information which is not related to a user at all, the example which 
does not receive the information after it is explained. 

[0053] Drawing 14 is drawing in the case of judging whether it is required [ from the first page ] 
in a lot of received data, or unnecessary, and canceling the information after degree page. 1401 
is a receiving side and 1402 is PC of a transmitting side. 

[0054] Processing of PC1401 in drawin g 14 is explained according to the flow chart of drawing 
12. 

[0055] As a result of referring to the assignment information on the advance notification 
corresponding to the class and conditions of JOB of drawing 127 at step S1 20, since it is only 
informational reception, it is judged that an advance notification does not carry out Processing 
is passed to step S125 at step S121. Since the page of the beginning of the received information 
is analyzed and it is with "information to a general-affairs person in charge" at step S125, it is 
the information which is not related to a user, and it is judged that reception of this information 
is unnecessary. Processing is passed to step S128 at step S126. At step S128, while canceling 
the 1st sheet which received, processing is ended without receiving the information after the 2nd 
sheet. 

[0056] [Operation gestalt 9] Drawing 15 is a flow chart which shows the procedure of this 
operation gestalt With this operation gestalt, the equipment to which activation of processing 
was directed judges whether it should perform for equipment itself, or it should perform with 
other equipments, and directs processing to activation or other equipments in person according 
to a decision result. 

[0057] First, in step S150, if whether JOB was inputted judges and it is inputted, JOB inputted 
into the JOB table will be added at step S151. [f it investigates whether there is JOB on a JOB 
table and is shown in it at step S152, JOB will be taken out at step S153. At step S154, the 
given directions are analyzed and the object of JOB is analyzed from the information. The own 
situation of equipment is judged at step S155. At step S156, the situation of other equipments 
according to the object of JOB is judged. 

[0058] If it is optimal to perform by oneself based on the situation of equipment itself and other 
equipments, it progresses to step S158 from step S157, and it will determine to perform by 
oneself and JOB will be performed by itself at step S159. On the other hand, if performing by 
oneself is not optimal and the optimal equipment according to the object of JOB exists in others, 
it will progress to step S161 from step S160, and will determine to perform JOB with equipments 
other than oneself, and activation of JOB will be directed to other equipments according to the 
object at step S162. At step S163, a user is notified of having performed JOB with equipments 
other than oneself. 

[0059] Moreover, if the equipment according to the object of JOB does not exist in others, it 

progresses to step S164 from step S160, the optimal approach which does not spoil the object 

of JOB is planned, and the plan is proposed to a user at step S165. 

[0060] Drawing 16 is drawing showing the information flow of this operation gestalt 

[0061] When the user of PC101 gives JOB which outputs the information inputted with the 

scanner 102 to a printer 104, it judges that given JOB cannot perform a printer 104, and a 



printer 104 finds the printer 103 which can take other equipments and communication and can 
perform given JOB, when it is a printing malfunction. ** which does not perform JOB by itself 
but is performed by the printer 103 by this is judged, and JOB is directed to a printer 103. 
Furthermore, in order to tell a user the action which he performed, it notifies to PC101. Drawing 
16 expresses this flow with an arrow head. 

[0062] Below, in processing of drawing 16 t the flow chart of drawing 1 5 is met and the 
procedure which each equipment processes is explained. 

[0063] First, if processing of a scanner 102 is explained, at step S150, information will be 
scanned and JOB which transmits information to a printer 104 will be received. At step S151, 
this JOB is added to a JOB table, and JOB is taken out at step S153. He understands that it is 
JOB which scans data and transmits at step S154. It judges that there is no problem in scanning 
the information which he was operating normally and was directed and transmitting at step S155. 

[0064] At step S156, he understands that JOB cannot be turned to other equipments. At step 
S157, since performing by oneself is optimal, processing is passed to step S158. At step S158, it 
determines to scan information by oneself, information is scanned at step S1 59, and information 
is transmitted to a printer 104 in the path of 1 through a network. 

[0065] On the other hand, by the printer 104, JOB which outputs the received information at 
step S150 is received. At step S151, this JOB is added to a JOB table. JOB is taken out at step 
S153. At step S154, he understands outputting the information of the user of PC101 to a form 
from the received information. At step S155, the toner is lost for itself, and it is judged that it 
cannot output to a form. At step S116, it communicates and it is judged that there is a printer 
103 in which an output is possible whether there is any printer which can output the information 
otherwise received through the network (2 paths). 

[0066] At step S157, since it cannot perform by itself, processing is passed to step S160. At 
step S160, it determines to transmit the information which received JOB of outputting 
information, to the printer 103 at step S161 since it was able to perform by the printer 103. It 
directs to output the information transmitted to a printer 103 at step S162 (3 paths). It notifies 
by E-mail having performed the output directed to PC101 of the user who directed JOB at step 
S163 by the printer 103 (4 paths). Drawing 12 8 is drawing showing an information flow in case 
the equipment according to the object of JOB does not exist. 

[0067] When the user of PC101 gives JOB which outputs the information inputted with the 
scanner 102 to a printer 104, the printer 103 according to the object of JOB that the printer 104 
took other equipments and communication as printing with a toner piece is impossible, and the 
printer 104 was given is found, and the situation is judged, here, in order to propose to a user, it 
notifies to PC101 recovering the condition which can print printers 104 or 103 as optimal plan, 
and printing, since a printer 103 cannot be printed with a form piece, it is alike other than this 
and the printer according to the object of JOB does not exist. Drawing 128 expresses this flow 
with an arrow head. 

[0068] Next, in processing of drawing 128 , the flow chart of drawing 15 is met and the procedure 
which each equipment processes is explained. 

[0069] It is the same until a scanner 102 reads a document and transmits to a printer 104. By 
the printer 104, JOB which outputs the received information at step S150 is received. At step 
S151, this JOB is added to a JOB table. JOB is taken out at step S153. At step S154, he 
understands outputting the information of the user of PC101 to a form from the received 
information. At step S155, the toner is lost for itself, and it is judged that it cannot output to a 
form. At step S1 1 6, although it communicates, a printer 103 cannot print whether there is any 
printer which can output the information otherwise received through the network because of a 
form piece, either, and it is judged that a device suitable out of it does not exist 
[0070] At step S157, since it cannot perform by itself, processing is passed to step S160. At 
step S160, since the device which can perform JOB of outputting information does not exist, it 
progresses to step s164. At step s164, the optimal approach for realizing printing which is the 
object of JOB of outputting information is planned. Consequently, it is planned that it is the 
optimal approach to return to normal the status of the device which can be printed. At 



continuing step s165, it proposes to a user recovering the condition which can print the printer 
104 of a toner piece, or the printer 103 of a form piece by Window as shown in drawing 129 
according to the planned result. Then, change of a users answer and the status of the printer 
itself is recognized as an input JOB, same processing is performed, and a user's object can be 
attained. 

[0071] The detail of the planning described above is explained henceforth [the operation gestalt 
1 1 ] based on an example. 

[0072] [Operation gestalt 10] In processing of the operation gestalt 9 at steps SI 58 and SI 59 In 
judging that JOB is performed by itself, and performing JOB directed further, when performing 
The existence of the generating in question is analyzed in a detail like the procedure of drawing 
17 mentioned later, and when it is judged that it is not suitable to carry out JOB activation 
depending on the environment and the situation of performing JOB, a problem may be notified, or 
JOB may be refused. 

[0073] For example, the directions are refused, when there are directions of printing of a 

confidential document and it is not checked with an authorized user. 

[0074] Drawing 1 7 is a flow chart showing the detailed procedure of JOB activation. 

[0075] At step S170, it analyzes whether it is satisfactory to activation of directed JOB. If there 

is no problem in activation of JOB at step S171, JOB will be performed at step S175. If there is 

a problem, it will judge whether a user is notified of the generated problem at step S172, or 

activation of JOB is refused. When notifying, a problem is notified at step S1 74. On the other 

hand, when refusing, it is step S176, and JOB is refused and refusal is notified. 

[0076] The case where it points so that the extra sensitive information which the user of PC101 

read with the scanner 102 may be hereafter outputted to a printer 104 is explained based on 

drawing 15 and 17. Drawing 18 is drawing showing the example of the extra sensitive information 

to read. 

[0077] First, with a scanner 102, at step SI 50, information is scanned and JOB which transmits 
information to a printer 104 is received. At step S151, this JOB is added to a JOB table. JOB is 
taken out at step S153. He understands that it is JOB which scans data and transmits at step 
S154. It judges that there is no problem in scanning the information which he was operating 
normally and was directed and transmitting at step S155. 

[0078] At step S155, he understands that JOB cannot be turned to other equipments. At step 
S157, since performing by oneself is optimal, processing is passed to step S158. At step S158, it 
determines to scan information by oneself. 

[0079] At step S170, as a result of scanning information, it analyzed that it was the confidential 
document for which an output is improper. There is a problem in activation of JOB at step S171. 
At step S172, it is judged that JOB (scan and output information) is refused. At step S173, since 
JOB is refused, processing is passed to step S176. Refusal of JOB is notified at step S176. 
[0080] Moreover, similarly, when two or more users use the same system, the present user can 
be recognized from a login name etc. and directions of the output of the content other users' file 
can be refused. Moreover, if the user of the destination differs from the present user also when 
a document is received from not directions but the exterior from a user, the output of an 
incoming correspondence and advice of the data of reception are refusable, or processing can 
also be suspended until the user of the destination uses a system. 

[0081] [Operation gestalt 1 1] The flow of processing is explained according to drawing 4 . First, a 
JOB table is initialized at step S109. It is confirmed whether, at step S110, there is any input 
from the input from a user, the device which can detect a system. Input analysis for analyzing 
the content inputted at the above-mentioned step at step S111 JOB It adds to a JOB table. It 
can perform at step S1 12. It confirms whether JOB exists, and if it is, it can perform at step 
S1 13. JOB is acquired. He understands the object which serves as a background which was 
going to perform JOB at step S1 14. 

[0082] At step S115, from the condition of the inputted content the device which can detect a 
system, and the information which the system knows now and others, the processing which it is 
considered is planned, and if required of step S116, new JOB will be added. Step S117- By S1 19, 
processing is performed according to the content planned at step S1 15. If lost, it will return to 



step S110 repeatedly, until JOB is lost. 

[0083] A user The case where it is going to print <file A> is explained. Drawing 22 shall be 
drawing showing the content of <file A>, and the part of the picture of a vehicle shall be drawn in 
the color. Moreover, drawing 23 is drawing showing the structure of a system of this operation 
gestalt, a user performs printing directions from PC2301, the monochrome printer 2303 is set up 
as a usually used printer, and the color printer 2302 is also connected in addition to it 
[0084] JOB table initialization is carried out at step S109. JOB performed at step S11 1 when 
anything does not have an input is added to a JOB table (drawing 19). Moreover, drawing 20 At 
Window, it is a file name. If <file A> is specified and printing is chosen, at step S 110, it will be 
judged that there is an input and it will progress to step S1 1 1. At step S1 11, as shown in drawing 
21 , the input analysis JOB is added to a JOB table ( drawing 21 ). It can perform at step S1 12. 
Since JOB exists, it progresses to step S113. It can perform at step S113. JOB: Input The 
analysis of "printing <file A>" is acquired, step S1 14 — an input — "printing <file A>" It is 
understood that the object is printing <file A>. 

[0085] At step S1 15, it plans proposing printing to a color printer from the following condition 
and situation to a user. 

- The part of a color is contained in <file A> (part of the vehicle of drawing 22 ). 

- The usable color printer 2302 exists ( drawing 23 ). 

[0086] A user is asked to "Whether to print by the color printer" at step S1 19 ( drawing 24 ). 
Simultaneously, JOB of a response in case there is no response of a user is added to a JOB 
table ( drawing 25 ). And it returns to step S1 10. 

[0087] If there is no intercadence force for 10 minutes, since JOB which can be performed 
exists by step S1 12 at step S1 10, it progresses to step S1 13. JOB which can be performed at 
step S113 : A response in case there is no response of a user is acquired. 

[0088] At step S1 14, it is understood that the object of a response in case there is no response 
of a user is knowing whether your accepting a proposal. At step S1 15, it opts for what a user is 
asked using a telephone from the following condition and situation. 

- The user knows the telephone number of the location which is now (schedule data of drawing 
26 R> 6). 

- It must print immediately (with the schedule data of drawing 26 , file A is used for a business 
talk from 13:00). 

[0089] A user is asked to "Whether to print by the color printer" at step S1 19 ( drawing 27 ). 
Simultaneously, JOB of a response in case there is no response of a user is added to a JOB 
table ( drawing 28 ). It returns to step S1 10. 

[0090] step S1 10 — drawing 27 — like — a user — "— yes — well — " — ** — if it says, it 
will be judged that there is an input and it will progress to step S1 1 1. At step S1 1 1, it is the input 
analysis JOB. It adds to a JOB table ( drawing 21 ). Since JOB which can be performed exists at 
step S112, it progresses to step S113. the JOB:input which can be performed at step S113 — " 

- it is and the analysis of "is acquired well. It inputs at step S114. "is and it is understood well 
that the object of "is that having accepted the proposal is shown. 

[0091] It determines to send <file A> to a color printer 2302, and to print it at step S1 15. Step 
S1 18 <file A> is sent to a color printer 2302, and is printed. Simultaneously, JOB for the check 
of whether printing was completed normally is added to a JOB table ( drawing 29 ). It returns to 
step S1 10. 

[0092] If the printer status changes to input nothing at step S1 10 and changes to "those with 
printed document" "out of printing" like drawing 30 at step S1 1 2, since JOB which can be 
performed exists, it progresses to step S1 13. JOB which can be performed at step S1 13: 
Acquire the processing corresponding to the printer status. Since it is the semantics that the 
document with which the status "those with a printed document" was printed is left behind to 
the tray of a printer from the printer status table of drawin g 31 at step S1 14, it is understood 
that the object is that a printed document passes into a user. 

[0093] Since a user may come to picking by step S1 15 immediately, at it, it determines to wait 
At step S1 16, JOB for the check of whether to have come the printed document to picking is 
added to a JOB table ( drawing 32 ). It returns to step S1 10. There is no intercadence force at 



step S110 for 10 minutes. Since JOB which can be performed exists at step S112 supposing a 
printed document is left behind, it progresses to step S1 13. JOB which can be performed at step 
S113: Acquire a response in case there is a printed document Since it is the semantics that the 
document with which the status "those with a printed document" was printed is left behind to 
the tray of a printer from drawing 31 R> 1 at step S1 14, it is understood that the object is that a 
printed document passes into a user. It is determined that a user judges that he forgets and it 
will notify "A printed document is in a color printer" at step S115 since a document is left 
behind for 10 minutes. At step S1 19, it notifies "A printed document is in BJC600" ( drawing 
33 ). Simultaneously, JOB of a response in case there is no response of a user in a JOB table, 
and JOB of the response at the time of coming a printed document to picking are added 
( drawing 34 R> 4). It returns to step S1 10. 

[0094] There is no input at step S1 10. If the printer status changes from "those with a printed 
document" to "it is normal" like drawing 28, since JOB which can be performed exists at step 
S112, it progresses to step S113. JOB which can be performed at step S113: Acquire 
reexamination of JOB corresponding to those with a printed document. At step S114, it is 
understood that the object of reexamination of JOB corresponding to those with a printed 
document is deleting JOB which became unnecessary. It determines to delete JOB which is 
waiting for a users response at step S115. JOB which is waiting for a users response is deleted 
at step S1 1 9. Here, new JOB is not added. By the initial state, it returns to step S1 10. 
[0095] Drawing 36 and 37 are drawings showing the rule of a plan and action. 
[0096] A user is printing of drawing 20 . Window When it sets and a carbon button [printing] is 
pushed, with reference to plan & action of the table of drawing 36 , it is judged that a user's 
object is that the present condition becomes "those with j3 printed document" Furthermore, 
since "those with a printed document" is also the target "printed document acquisition" 
prerequisite, it is judged that a final user's object is "printed document acquisition. 
[0097] A user is the question of drawing 24 or drawi ng 33 . When voice, mouse actuation, etc. 
perform actuation of approval manifestation or anti-mind manifestation to the inquiry by Window 
and the telephone of drawing 27 , it is judged that a users objects are the approval manifestation 
to an inquiry and anti-mind manifestation. 

[0098] In drawing 37 , the ultimate object of a system is the object achievement of a user. As a 
prerequisite for that, the system must be stable. Moreover, a system understands ** user s 
object on it, and the ** object achievement is planned and it performs. 

[0099] As well as normalizing a system at the time of trouble, for the cutback of cost, or evasion 
of destabilization of a system, when there is no need of performing, a power source is turned off 
for stability of a system. 

[01 00] Drawing 38 illustrates a part of drawing 37 intelligibly. 

[0101] In order to understand a users object, he understands an input when there is an input 
Moreover, corresponding to "printed document acquisition" of the object of the user of drawin g 
36 , what "a printed document is passed to a user for" exists as an object of a system. 
[0102] In order to pass a user a printed document, it is a premise that the printed document 
exists and it is going to attain the object by teaching a user the location which has a document 
on it Of course, although a user comes a document to picking or a document must be sent to a 
user by a certain approach in order for a user to acquire a document actually, in this system, in 
detail, the definition was not carried out but that a printed document is lost has judged that it is 
equivalent to the user having acquired. 

[0103] On the other hand, in order for there to be a printed document, while there is a printing 
agency document, printing conditions are clarified, it is a premise that the printing environment 
where it corresponds exists normally, the printing environment where it corresponds on it is 
chosen, and printing is performed. What is necessary is just to draw up a printing agency 
document, in order for there to be a printing agency document In order to clarify printing 
conditions, conditions should just ask a user an indefinite part. What is necessary is just to 
normalize a printing environment, when a printing environment is unusual in order for the printing 
environment to be normal. Moreover, RIPURANNINGU anew when there is no response from a 
fixed time amount user in order to acquire a user's volition. 



[0104] The property of each device is stored in the memory in the server which has managed 
the memory or each device inside each device. Drawing 39 is the example of the property of 
each device. The status of each device is having in the interior of each device, and each device's 
sending actively, or returning passively according to the demand of other servers etc., and is told 
to other equipments. 

[0105] [n this system, a property is the thing of each device proper, and since it does not 
change, when the connection on the time of starting of a system or a network has modification, 
it is acquired. On the other hand, in the process which plans, the status is acquired if needed, or 
is acquired with a certain fixed time interval, and updating storage is carried out as information in 
internal memory. 

[0106] [Operation gestalt 12] As well as the operation gestalt 1 1, when printing <file A>, it is the 
example of processing in case a color printer is Busy. 

[0107] First, input: If there is "printing <file A>", this will be added to a JOB table and it will be 
understood that the object is printing, here, the part of a color contains in a document as a 
condition and a situation — having — **** — an usable color printer — Busy it is — ** — it 
carries out Then, the plan to ask a user whether it waits or it prints in monochrome is stood 
until it stops being Busy. "Color printer is Busy, is it waiting measure? Or does it print by the 
monochrome printer? " — a user is questioned. A user When "it waits" is chosen, it stands by 
until it stops being Busy. 
[0108] [Operation gestalt 13] 

Input "<file A> was changed into <file A'X When there is ", it is understood that renewal of a 
JOB table is the object. In a condition and a situation, <file A> prints on a JOB table. JOB It is. 
Then, it asks a user whether the object for printing is changed into <file A'X The plan to say is 
stood. And the question "whether <file A'> is printed instead of <file A> before correction" is 
emitted. 

[0109] [Operation gestalt 14] In the system (in this case, it connects with the network) to which, 
as for this operation gestalt, two or more equipments were connected When JOB is directed to 
each equipment, each equipment analyzes the object of JOB, and when it judges that it is better 
not to perform JOB activation with the equipment directed from its situation or the situation of 
a designating device, it is an operation gestalt for transmitting and performing JOB to other 
equipments. 

[0110] Drawing 41 is two examples showing the condition that two or more equipments are 
connected to the network, and (A) is the network of the environment where each equipment of a 
scanner 41 1 and printers 412 and 413 can judge each situation. (B) is the network of the 
environment where a scanner 41 1 cannot judge the situation of printers 412 and 413. 
[0111] Drawing 42 is drawing showing the functional configuration for processing this operation 
gestalt The JOB receipt section 421 receives JOB from a user or other equipments. Received 
JOB is registered into the JOB table 422. The JOB analysis section 423 takes out and analyzes 
JOB registered into the JOB table 422. The other equipment situation seal step 424 judges an 
attribute, a current condition, etc. of other connected equipments. The self-equipment situation 
seal step 427 judges the own attribute, own current condition, etc. of equipment 
[0112] The optimal planning section 425 stands the optimal plan about activation of JOB. In the 
JOB activation decision section 426, when performing whether JOB is performed or not, it 
judges performing with other equipments whether it performs with self-equipment etc. When 
performing with self-equipment, it performs in the JOB activation section 428. When performing 
with other equipments, JOB is transmitted to other devices by the JOB transfer section 429 to 
other equipments. The advice section 21 1 of activation notifies a user of having transmitted JOB 
to an activation result or other equipments etc. 

[01 13] Drawing 43 is the flow chart showing the flow of the processing for realizing this 
operation gestalt of Maine. First at step S430, it judges whether JOB was inputted by confirming 
whether there is new JOB generated by itself at the input JOB from the input JOB from a user, 
the device which can detect a system, the result of having analyzed these JOB(s), and the time 
of an idling. If inputted, JOB inputted into the JOB table will be added at step S431. If it 
investigates whether there is JOB on a JOB table and is shown in it at step S432, JOB will be 



taken out at step S433. At step S434, the given directions are analyzed and the object of JOB is 
analyzed from the information. At step S435, it judges whether there is JOB to other 
equipments, and if it is, other equipments will be controlled by step S436. If there is nothing, 
self-equipment will be controlled by step S437. 

[01 1 4] Drawing 44 is a flow chart showing the flow of the processing when controlling other 
equipments, when processing to other equipments in the Maine processing at step S436. 
[0115] The situation of the equipment specified in JOB is judged at step S440, and it judges 
whether a problem is to perform JOB with the specified equipment at step S441 based on this 
decision. If satisfactory, JOB will be transmitted to the specified equipment at step S442. The 
situation will be judged, if it investigates whether there is any equipment suitable for the JOB 
and is with equipments other than the specified equipment at step S443, when a problem is in 
activation with the specified equipment Consequently, if there is equipment which can perform 
the JOB except the specified equipment, a user will be notified of having transmitted JOB to the 
equipment and having transmitted JOB at step S446 at step S445. The optimal plan which is 
step S447 and does not spoil the object of JOB with any equipments other than the specified 
equipment on the other hand when current utilization cannot be carried out, even if there is no 
equipment suitable for the JOB or it is is stood, it is step S448 and the plan is proposed to a 
user. 

[01 16] Drawing 45 is a flow chart which expresses the flow of processing in the case of 
processing with its own equipment with step S437 in the Maine processing. 

[0117] At step S450, the situation of self-equipment is judged and it judges whether a problem is 
to perform JOB with self-equipment by step S451 based on this decision. If satisfactory, JOB 
will be performed at step S452. The situation will be judged, if it investigates whether there is 
any equipment suitable for the JOB and is with equipments other than self-equipment at step 
S453, when a problem is in activation with self-equipment. Consequently, if there is equipment 
which can perform the JOB except self^equipment, a user will be notified of having transmitted 
JOB to the equipment and having transmitted JOB at step S446 at step S445. The optimal plan 
which is step S447 and does not spoil the object of JOB with any equipments other than self- 
equipment on the other hand when current utilization cannot be carried out, even if there is no 
equipment suitable for the JOB or it is is stood, it is step S448 and the plan is proposed to a 
user. 

[01 18] In (A) of drawing 41 , it pointed so that the information read from the scanner 41 1 might 
be outputted to a printer 412 in the path of A, but in the other equipment situation seal step 424 
of a scanner 41 1, since draw ing 46 discovered failure to the printer 412, it is drawing when 
outputting to a printer 413 through the path of B. 

[01 19] Although it points to drawing 47 so that the information read from the scanner 41 1 may 
be outputted to a printer 41 2 in the path of A in (B) of drawing 41 , and a scanner 41 1 tends to 
check the situation of a printer 412 Since it is in the distant location, in consideration of a 
network situation, information is transmitted unconditionally, and it is drawing since he is out of 
order, when a printer 412 transmits the received information (JOB) to a printer 413 in the path 
of B. 

[0120] Drawin g 46 and the process in which processing of 47 is performed are explained based 
on the flow chart of drawing 43 -45 below. 

[0121] When an output JOB occurs from the scanner 41 1 of drawing 46 to a printer 412, 
processing of a scanner 411 is as follows. 

[0122] First at step S430, information is scanned and JOB which transmits information to a 
printer 412 is received. At step S431, JOB is added to a JOB table. JOB is taken out at step 
S433. At step S434, he scans data and understands that this JOB is JOB which transmits to the 
directed printer. It judges that there is JOB which performs information which he scanned with 
other equipments of outputting by the printer 412 at step S435. By this decision, processing is 
passed to other device control processing of drawing 44 at step S436. 

[0123] The current condition of the directed printer 412 is acquired at step S440. Consequently, 
. it judges that an output is impossible at a receipt and step S441 in the information which is 
breaking down from a printer 412. In this case, also when it is in the condition that outputs, such 



as a form piece and a toner piece, cannot be performed even if it is not [ be / it ] under failure 
for example, it thinks. At step S443, since it is impossible to perform JOB, from on a network, 
communication is taken and other same equipments which can perform JOB are searched with 
the printer 412 which is directed equipment. Since the printer 413 which can perform JOB was 
discovered at step S444, it opts for activation of JOB in a printer 413. 

[0124] At step S445, the scanned information is transmitted to a printer 413. It notifies having 
changed JOB at step S446, to the partner who directed, since the thing except having been 
directed was performed. Since processing of directed JOB was ended above, it waits until the 
next JOB is inputted. 

[0125] Next, processing when an output JOB occurs from the scanner 41 1 of drawing 47 to a 
printer 412 is explained. 

[0126] With a scanner 41 1, at step S430, information is scanned and JOB which transmits 
information to a printer 412 is received. At step S431, JOB is added to a JOB table, and JOB is 
taken out at step S433. At step S434, he scans data and understands that this JOB is JOB 
which transmits to the directed printer. It judges that there is JOB which performs information 
which he scanned to other equipments of outputting by the printer 412, at step S435. By this 
decision, processing is passed to other device control processing of drawing 44 at step S436. 
[0127] Although it is going to communicate with the directed printer 412 and is going to get to 
know the situation at step S440, since it is checked that it is in the location which the printer 
412 left, it judges transmitting information regardless of the condition of a printer 412. At step 
S441, since the printer 412 is separated, it is judged as a satisfactory thing. At step S442, the 
information scanned to the printer 412 which is directed equipment is transmitted, and JOB is 
passed. Since processing of directed JOB was ended above, it waits until the next JOB is 
inputted. 

[0128] On the other hand, by the printer 412, JOB which outputs the received information at 
step S430 is received. At step S431, JOB is added to a JOB table. JOB is taken out at step 
S433. He understands that it is JOB to which he outputs the received information at step S434. 
At step S435, it is judged that there is no JOB to other equipments. Processing is passed to 
self-device control processing of drawing 45 at step S437. 

[0129] Its current condition is seen at step S450. At step S451, he judges that it is [ current ] 
under failure and activation of JOB cannot be performed. In this case, also when it is in the 
condition that outputs, such as a form piece and a toner piece, cannot be performed even if it is 
not [ be / it ] under failure for example, it thinks. Communication is taken from on a network and 
the same equipments of other as themselves which can perform JOB are searched with step 
S453. 

[0130] Since the printer 413 which can perform JOB was discovered at step S454, it opts for 
activation of JOB in a printer 413. At step S455, the information transmitted to the printer 412 
is broadcast again to a printer 413. It notifies having changed JOB at step S456, to the partner 
who directed, since processing except having been directed was performed. Here, although the 
partner who directed was notified, since it is the location distant from the partner whom the 
output destination change directed, it may be made to notify to a recipient Since processing of 
JOB directed above was ended, it waits until the next JOB is inputted. A printer 413 does not 
have a problem, and since JOB which outputs the received information can be performed, JOB 
is performed. 

[0131] Although each equipment transmitted JOB automatically with the above operation gestalt, 
when a problem is in each equipment it is also possible to attach and set up ranking so that a 
user may transmit JOB. For example, in this operation gestalt although the user has inputted 
printing by the printer which specified the scanned document as JOB, when the printer specified 
at this time is unusable, the 2nd and 3rd printer which executes printing by proxy may be 
simultaneously set up into JOB. Thereby, as a device which fitted JOB in step s443 or step 
s453, the 2nd and 3rd set-up printer is chosen and the situation is judged. Moreover, when he is 
unusable, the 2nd and 3rd printer which executes printing by proxy may be set to the printer side 
which receives JOB conversely. At this time, though the 2nd and 3rd printer is set up by the 
JOB itself as mentioned above, the printer which received JOB can transmit JOB according to 



the assignment set as itself. 

[0132] Moreover, when failure and actuation are impossible, even if it is except, when JOB of the 
spec, unsuitable for performing JOB, for example, a monochrome printer, is printing of the 
information on a color, or also when there is much waiting for JOB and it cannot process 
immediately, it can become the decision conditions which do not perform JOB. 
[0133] [Operation gestalt 15] In performing JOB which outputs the emergency intelligence which 
the printer received to a user, this operation gestalt expresses the processing in the case of also 
considering the target users schedule information as a decision ingredient which judges the 
problem of activation of JOB in the processing which judges the situation of the self-equipment 
of step S450 of drawing 45 . 

[0134] Here, the user who should tell emergency intelligence is out and processing of the 
environment shown in drawing 48 in which the printer 413 connected to the going-out place in 
the network exists is explained. 

[0135] In this case, in the procedure of drawing 43 t the object of JOB understands that it is 
connecting the received information to a user immediately at step S434. At step S435, since it is 
not JOB to other equipments at this event, processing is passed to step S437. Processing is 
passed to self-device control processing of drawing 45 at step S437. 

[0136] At step S450, when judging the situation of self-equipment, a users schedule directed as 
a transmission place is checked to equipment 414, and it is judged that he is out At step S451, 
since a user is going out [ be / it ], for urgent communication, it is judged that a problem is in 
activation with self-equipment. It checks whether at step S453, the printer in which an output of 
information is possible is in a going-out place. Since it checked that there was a printer 412 in 
which an output is possible at step S454, it determines to output by the printer. At step S455, 
information is transmitted to a printer 412. At step S456, the user of the destination is notified 
of having transmitted JOB delivery origin. 

[0137] Moreover, when it is judged that there are other equipments which a user uses, for 
example, PC, FAX, a telephone, etc. at step S443 by the case where there is no equipment in 
which the output same as the destination of JOB is possible, it is good though performed with 
the equipment in step S444. However, since information cannot be transmitted as it is, at step 
S445, the print-out to a printer is changed, and will make it an electronic mail document and a 
FAX document, and it will transmit, or will change and output to speech information. 
[0138] It is not necessary to notify having transmitted JOB anew using another media depending 
on the media used for an output, and can also tell simultaneously by the same media at step 
S446 at this time. For example, when transmitting a print-out using a telephone, the rear stirrup 
which told the print-out is considered as it is more smart to tell the data of having transmitted 
before. 

[0139] In addition, it is step S447 and determines to use those equipments as optimal plan which 
does not spoil the object of JOB, and it is step S448 and you may make it propose the plan, 
without judging PC mentioned above, FAX, a telephone, etc. to be the devices suitable for JOB 
which should be performed by the printer at step S443. 

[0140] [Operation gestalt 16] The procedure of this operation gestalt is shown in drawing 49 . 
Drawing 49 adds step S498-500 as processing when there is no JOB in the flow chart of drawin g 
43 . At step S498, by step S499, the current situation of other equipments of operation is 
investigated, and it judges whether others and equipment are covered with, without performing 
JOB which can be performed by itself, and when having collected, at step S500, the JOB is 
taken out, and it adds to the JOB table of seH^equipment, and deletes from the JOB table of 
partner equipment Thus, with this operation gestalt, JOB is found out and processed itself. 
[0141] Drawing 50 is in the situation of performing this processing, and since JOB does not exist 
in a printer 412 but the printer 413 has ten waiting JOB(s), it is drawing showing the concept 
which a printer 415 takes out JOB of a printer 413 and processes with self-equipment. 
[0142] The flow of processing of a printer 415 is as follows. At step S492, since there is no JOB, 
it passes processing to step S498. At step S498, the current situation of the printer 412 which 
are other equipments, and a printer 413 is investigated. It judges that JOB which can be 
performed by itself is in a printer 413 at step S499. At step S500, the JOB is added to ejection 



and its own JOB table from a printer 413. Furthermore, taken-out JOB is deleted from a printer 
413. There is no input of JOB at step S490. Since JOB which added the point by itself exists at 
step S492, processing is passed to step S493 in order to perform JOB. 

[0143] Henceforth, actuation for performing with one's equipment explained with the operation 
gestalten 14 and 15 is performed, and processing is ended. 

[0144] [Operation gestalt 17] Drawin g 51 is drawing having shown the flow of Print JOB in the 
system which used the equipment of this operation gestalt, and other information flows. In 
addition, the thick arrow head in drawing expresses the flow of Print JOB, and the arrow head of 
a dotted line expresses other information flows. 

[0145] However, the parameters referred to at the time of printing of the document used as the 
object for printing and printing number of sheets, printing quality, printing size, etc. are included 
in the print JOB stated with this operation gestalt Moreover, there are the statuses, such as 
normal and those without a form, and a schedule of the print JOB which the print JOB 
scheduling section has in the information on other during printing which each printer has. 
[0146] In drawing 51 , with a client machine 510, once creating Print JOB in the print JOB 
creation section 512 and memorizing in the print JOB storage section 513, it is transmitted to 
the server machine 51 1 which manages a printer by the print JOB transmitting section 514 from 
the client machine 510 which created Print JOB. 

[0147] In a server machine 511, when the parameters of reception and Print JOB have not set 
up the sent print JOB by the print JOB receive section 516, the print JOB automatic setting 
section 517 is passed, and delivery and when already being set up, the print JOB automatic 
modification section 518 is passed. 

[0148] A non-set up printing parameter is set up in the print JOB automatic setting section 517, 
taking into consideration the urgency acquired from Print JOB, profitability, quality, etc. On the 
other hand, in the print JOB automatic modification section 518, changing the parameter already 
set up in the same processing is also realized. Thus, the print JOB set up or changed is 
registered into the schedule of the print JOB which the print JOB scheduling section 520 has, 
and reading appearance is carried out from there to the sequential print JOB transmitting 
section 519, or it is printed over the immediate printing JOB transmitting section 519. 
[0149] Here, the status of usable printers acquired through the printer situation-recognition 
section 515, such as under printing, normal, and those without a form, includes the print JOB 
automatic setting section 517 and the print JOB automatic modification section 518, and it is 
used for them in setting out or modification of Print JOB. Moreover, the printing schedule of the 
print JOB which the print JOB scheduling section 520 has is gone across and used similarly. 
[0150] Moreover, as expressed to drawin g 51 , it is also assumed that Print JOB flows in a 
different path. For example, when the machine which has managed the printer is the same as the 
machine which created Print JOB, it cannot pass along the print JOB transmitting section 514. 
[0151] Drawing 52 is a flow chart showing the flow of processing of the print JOB automatic 
setting section 517. Automatic setting of the parameter is carried out so that it can print as 
quickly as possible and as economically as possible in the range which is satisfied with the print 
JOB automatic setting section 517 of the specified quality. 

[0152] At drawing 52 , the factor which determines printing time amount and the amount of the 
toner used is first initialized as preparation of a simulation at step S520. Then, a quality decision 
variable is initialized by the quality peak price (for example, 5) at step S521, and printing time 
amount is simulated at step S522. It judges whether the printing time amount which it simulated 
fills an assignment value with step S523. When filled, it is step S524 and the amount of the toner 
used is simulated. It judges whether the amount of the toner used which it simulated fills an 
assignment value with step S525. When filled, it is step S526 and JOB is changed into the value 
of a current quality decision variable. 

[0153] Step S When not filling the specified value with 523 or 525, one quality decision variable 
is reduced at step S527. Whether the specified quality is filled with step S528 judges, and if filled, 
processing will be returned to step S522. If not filled, it becomes an automatic setting impossible 
error and ends. 

[0154] Drawing 53 is drawing showing the printing time amount and the amount of the toner used 



of per [ used ] character by the difference in the assignment quality of a printer A521 and a 
printer B522. The eternal value of each printer proper is sufficient as these values, and the value 
which measures the business time amount and the amount of the toner used of printing used 
performed in the past, and took the average from this measured value and which changes 
dynamically is sufficient as them. 

[0155] Drawing 54 is drawing showing the parameter which the user specified as the content of 
the print JOB printed with this operation gestalt. In the system using this operation gestalt it is 
called Print JOB in accordance with the content of the print JOB expressed with drawing 54 , 
and the active parameter. With this operation gestalt, in order to simulate printing time amount 
and the amount of the toner used, the amount of printings of Print JOB is explained as 500 
characters by the number conversion of alphabetic characters. Moreover, the user should 
specify only urgency as less than 1 minute, and neither profitability nor quality should be 
specified with the default 

[0156] In the example of drawing 54 , starting of the print JOB automatic setting section 517 
initializes the factor which determines printing time amount and the amount of the toner used in 
preparation of a simulation of step S520 first For example, as it was defined as the table of 
drawing 53 , each printing time amount per character in the case of the minimum quality (= 1) of 
a printer A521 and a printer B522 is the an average of 100m step S and the 200m step S, and 
the amount of the toner used per character is an average of 100mg and 200mg. 
[0157] Then, a quality decision variable is initialized by the quality peak price (for example, 5) at 
step S521, and printing time amount is simulated at step S522. For example, if one does not have 
the print JOB by which can print and the schedule is carried out by print JOB scheduling, 
printing can be started immediately and the latency time of a printer A521 and a printer B522 is 
unnecessary. Therefore, when 500 characters are contained in the print JOB for printing, by 
Printer A, it takes 250 seconds, and if it takes 500 seconds, it will simulate by Printer B. 
[0158] Then, since less than [ urgency 1 minute ] which was specified with the assignment 
parameter of drawing 54 cannot be filled with step S523, one quality decision variable is reduced 
at step S527. Here, since quality is not specified with the assignment parameter of drawing 54 , 
processing is again returned to the simulation of the printing time amount of step S522. Since 
printing time amount becomes 50 seconds by the printer A521 only after quality is set to 1 of 
the minimum quality as a result of repeating these processings, and urgency is fulfilled, quality is 
set as the value (= 1) of a quality decision variable, and is terminated normally. 
[0159] Here, since the parameter which the user set up cannot be filled supposing it has set 
quality or more to two, it becomes an automatic setting impossible error and ends. 
[0160] [Operation gestalt 18] Drawing 55 is a flow chart showing the flow of processing of the 
print JOB automatic modification section 518. In the range which is satisfied with the print JOB 
automatic modification section 518 of the urgency and profitability which were specified, an 
automatic change of the parameter is made so that it can print for high quality as much as 
possible. When it cannot be satisfied with on top of that of all assignment assignment of the 
highest priority is satisfied, and other assignment is changed so that closely [ assignment ] as 
much as possible. 

[0161] Drawing 56 is drawing showing the parameter which the user specified as the content of 
the print JOB printed with this operation gestalt. In the system using this operation gestalt it is 
called the content of the print JOB expressed with drawing 56 with Print JOB in accordance 
with the active parameter. With this operation gestalt, in order to simulate printing time amount 
and the amount of the toner used, the amount of printings of Print JOB is explained as 500 
characters by the number conversion of alphabetic characters. Moreover, although the user set 
up all the parameters, it is specified also in it that quality is top priority. 
[0162] In drawing 55 , starting of the print JOB automatic modification section 518 first 
initializes the factor which determines printing time amount and the amount of the toner used in 
preparation of a simulation at step S550. For example, as it was defined as the table of drawing 
53 , each printing time amount per character in the case of the minimum quality (= 1) of Printer 
A and Printer B is the an average of 100m step S and the 200m step S, and the amount of the 
toner used per character is an average of 100mg and 200mg. 



[0163] Then, a quality decision variable is initialized by the quality peak price (for example, 5) at 
step S551, and printing time amount is simulated at step S552. For example, if one does not have 
the print JOB by which can print and the schedule is carried out in the print JOB scheduling 
section 520, printing can be started immediately and the latency time of a printer A521 and a 
printer B522 is unnecessary. Therefore, when 500 characters are contained in the print JOB for 
printing, by the printer A521, it takes 250 seconds, and if it takes 500 seconds, it will simulate by 
the printer B522. 

[0164] Then, since less than [ urgency 1 minute ] which was specified with the assignment 
parameter of drawing 56 cannot be filled with step S553, one quality decision variable is reduced 
at step S556. Since assignment of the quality of the assignment parameter of drawing 56 is filled 
with step S557, processing is again returned to the simulation of the printing time amount of 
step S552. As a result of repeating these processings, even if it becomes the quality (= 3) 
specified by a user, printing time amount is 150 seconds by the printer A521, and cannot fulfill 
urgency. Then, if a quality decision variable is reduced by one, since it becomes impossible to fill 
the quality specified by a user with step S557, it progresses to step S558, and quality will have it 
confirmed whether to be an assignment parameter of the highest priority, and will change and 
terminate Print JOB normally with step S556 in the specified quality by step S560 the case of 
the highest priority. 

[0165] Here, since printing time amount will become 50 seconds by Printer A only after quality is 
set to 1 of the minimum quality and urgency will be fulfilled supposing urgency is top priority, 
quality is set as the value (= 1) of a quality decision variable, and is terminated normally. 
[0166] [Operation gestalt 1 9] Drawing 57 is drawing having shown the flow of Print JOB in the 
system which used the equipment of this operation gestalt, and other information flows. In 
addition, the thick arrow head in drawing expresses the flow of Print JOB, and the arrow head of 
a dotted line expresses other information flows. 

[0167] However, the parameters referred to at the time of printing of the document used as the 
object for printing and printing number of sheets, printing quality, printing size, etc. are included 
in the print JOB stated with this operation gestalt Moreover, there are the statuses, such as 
normal and those without a form, and a schedule of the print JOB which print JOB scheduling 
has in the information on other during printing which each printer has. 
[0168] In drawing 57 , with a client machine 510, once creating Print JOB in the print JOB 
creation section 512 and memorizing in the print JOB storage section 513, it is transmitted to 
the server machine 51 1 which manages a printer by the print JOB transmitting section 514 from 
the client machine 510 which created Print JOB. 

[0169] In a server machine 511, the sent print JOB is passed to reception and the print JOB 
interpretation section 571 by the print JOB receive section 516. In the print JOB interpretation 
section 571, the directions from a user included in the received print JOB are interpreted, and it 
changes into information, such as a parameter which can process a system. When the 
parameters of Print JOB have not been set up, the print JOB automatic setting section 517 is 
passed, and delivery and when already being set up, the print JOB automatic modification 
section 518 is passed. 

[0170] A non-set up printing parameter is set up in the print JOB automatic setting section 517, 
taking into consideration the urgency acquired from Print JOB, profitability, quality, etc. On the 
other hand, in the print JOB automatic modification section 518, changing the parameter already 
set up in the same processing is also realized. Thus, the print JOB set up or changed is 
registered into the schedule of the print JOB which the print JOB scheduling section 520 has, 
and reading appearance is carried out from there to the sequential print JOB transmitting 
section 519, or it is printed over the immediate printing JOB transmitting section. 
[0171] Here, the status of usable printers, such as normal and those without a form, includes the 
print JOB automatic setting section and the print JOB automatic modification section 518 during 
printing acquired through the printer situation-recognition section 515, and it is used for them in 
setting out or modification of Print JOB. Moreover, the printing schedule of the print JOB which 
the print JOB scheduling section 520 has similarly is also gone across and used. 
[0172] Moreover, as expressed to drawin g 57 , it is also assumed that Print JOB flows in a 



different path. For example, when the machine which has managed the printer is the same as the 
machine which created Print JOB, it cannot pass along the print JOB transmitting section 514. 
[0173] With this operation gestalt as shown in drawing 58 , setting out of the parameter of Print 
JOB is vaguely set up using natural language. Drawing 130 is drawing having shown the 
semantics which the character string in a parameter setup expresses, and a demand item 
required in order to complete the semantics corresponding to the input string by natural 
language. In the print JOB interpretation section 571, it interprets as follows with reference to 
the semantics corresponding to the input string by the natural language which showed directions 
by the natural language passed as a print JOB active parameter in drawing 130 , and a demand 
item required in order to complete semantics. 

[0174] Action used as a users object which a character string "printing" to this character string 
under inputted natural language means is [printing]. Furthermore, the item demanded from there 
and a [object] are the contents of the print JOB inputted simultaneously itself, and [quality] and 
[number of sheets] will be expected if it should be specified in the part as which it is not 
interpreted under inputted natural language, then, a character string — " — the object for 
customers — an interpretation of one sheet and five-sheet" for members understands being 
specified that [number-of-sheets] 1 sheet is printed in high-definition [quality], and it prints 
[number-of-sheets] 5 sheet in free [quality]. 

[0175] Processing of the print JOB automatic setting section 51 7 and the print JOB automatic 
modification section 518 after this is the same as that of the operation gestalten 17 and 18. 
[0176] [Operation gestalt 20] With this operation gestalt, as shown in drawing 59 , setting out of 
the parameter of Print JOB is performed based on the distribution place and number of sheets 
which were indicated by the document itself which is the content of the print JOB. In the print 
JOB interpretation section 571, the content of the print JOB is interpreted and it operates as 
follows. Action is printing. "The object for customers" interprets it as high-definition, and makes 
number of sheets one sheet. An "ABC project" is "an object for members", interprets it as 
grace being free, and number of sheets makes it five sheets (it has in advance the information 
that a user is the member of an ABC project). 

[0177] The processing after the print JOB automatic setting section 517 and the print JOB 
automatic modification section 518 after this is the same as that of the operation gestalten 17 
and 18. 

[0178] [Operation gestalt 21] Drawing 60 is drawing having shown the flow of Print JOB in the 
system which used the equipment of this operation gestalt, and other information flows. In 
addition, the thick arrow head in drawing expresses the flow of Print JOB, and the arrow head of 
a dotted line expresses other information flows. 

[0179] However, the parameters referred to at the time of printing of the document used as the 
object for printing and printing number of sheets, printing quality, printing size, etc. are included 
in the print JOB stated with this operation gestalt Moreover, there are the statuses, such as 
normal and those without a form, and a schedule of the print JOB which the print JOB 
scheduling section 520 has in the information on other during printing which each printer has. 
[0180] In drawing 60 , with a client machine 510, once creating Print JOB in the print JOB 
creation section 512 and memorizing in the print JOB storage section 513, it is transmitted to 
the server machine 51 1 which manages a printer by the print JOB transmitting section 514 from 
the client machine 510 which created Print JOB. 

[0181] In a server machine 511, the sent print JOB is passed to reception and the print JOB 
interpretation section 571 by the print JOB receive section 516. In the print JOB interpretation 
section 571, the directions from a user included in the received print JOB are interpreted, and it 
changes into information, such as a parameter which can process a system. When the 
parameters of Print JOB have not been set up, the print JOB automatic setting section 517 is 
passed, and delivery and when already being set up, the print JOB automatic modification 
section 518 is passed. Moreover, in the print JOB simulation section 601, printing by setting out 
specified on Print JOB is simulated, and printing time amount and the amount of the toner used 
are calculated. 

[0182] A non-set up printing parameter is set up in the print JOB automatic setting section 517, 



taking into consideration the urgency acquired from Print JOB, profitability, quality, etc. On the 
other hand, in the print JOB automatic modification section 518, changing the parameter already 
set up in the same processing is also realized. Thus, the print JOB set up or changed is 
registered into the schedule of the print JOB which the print JOB scheduling section 520 has, 
and reading appearance is carried out from there to the sequential print JOB transmitting 
section 519, or it is printed over the immediate printing JOB transmitting section 519. 
[0183] Here, the status of usable printers, such as normal and those without a form, includes the 
print JOB automatic setting section 517 and the print JOB automatic modification section 518 
during printing acquired through the printer situation-recognition section 515, and it is used for 
them in setting out or modification of Print JOB. Moreover, the printing schedule of the print 
JOB which the print JOB scheduling section 520 has similarly is also gone across and used. 
[0184] Moreover, as expressed to drawing 60 , it is also assumed that Print JOB flows in a 
different path. For example, when the machine which has managed the printer is the same as the 
machine which created Print JOB, it may not pass along the print JOB transmitting section 514. 
[0185] Drawing 61 is the flow chart of processing by the print JOB simulation section 601. In the 
print JOB simulation section 601, the factor which determines printing time amount and the 
amount of the toner used is first initialized as preparation of a simulation at step S611. At step 
S612, the printing time amount in setting out specified on Print JOB is simulated, the amount of 
the toner used in setting out specified on Print JOB by step S613 is simulated, and printing time 
amount and the amount of the toner used are calculated. 

[0186] The concrete approach is the same as that of what was explained with the operation 
gestalten 1 7 and 1 8. 

[0187] [Operation gestalt 22] With this operation gestalt, two or more output trays are prepared 
in a printer, and the tray outputted according to a user is chosen. 

[0188] Drawing 62 is the flow chart of the procedure of the printer system of this operation 
gestalt A printer system starts processing of drawing 62 , after processing the response at the 
time of receiving two or more prints JOB simultaneously etc., if Print JOB is received. 
[0189] The external view of the printer of the printer system of this operation gestalt is shown in 
drawing 63 . As shown in this drawing, these printers 631 and 632 have two or more output trays, 
have the screen which indicates whose document the document on that tray is in each output 
tray by the printer 631, and express whose document is shown in a common screen at which 
output tray as a printer 632. Moreover, if the user is beforehand set up for every output tray, it 
becomes an output tray only for users, and if it does not set up especially, the user of each 
output tray will change if needed. 

[0190] Functions, such as telling the failure of a printed document which tells arrival of a 
document and which tells termination of printing taking by this system (the sensor sticking), are 
realized. The flow of the above processing is explained. 

[0191] In drawing 62 , receivers address information is acquired from the information included in 
Print JOB at step S621. Receivers address information is acquired by interpreting the 
assignment filled in as the operation gestalt 29 explaining into the content of the print JOB, or is 
acquired from the information set up apart from the content of the print JOB from the beginning 
like E-mail. When using it, usually carrying out like [ instead of FAX or E-mail ] like [ although the 
receiver's address is not specified ] the system using this operation gestalt in using a printer as 
an output device of the usual personal computer like the example of an activity of the 
conventional technique at this time, usually the receiver's address is specified as reverse. At 
step S622, it is confirmed whether the receiver s address is specified. At step S623, the man of 
the receiver's address is notified of the document having arrived. At step S624, sending agency 
information is acquired from the information included in Print JOB. Sending agency information is 
acquired by interpreting the assignment filled in as the operation gestalt 29 explaining into the 
content of the print JOB, or is acquired from the information set up apart from the content of 
the print JOB from the beginning like E-mail. When using it, usually carrying out like [ instead of 
FAX ] like [ although a sending agency is in the management range of this system ] the system 
using this operation gestalt in using a printer as an output device of the usual personal computer 
like before at this time, as for sending-conversely origin, it is common that there is nothing in 



the management range. At step S625, it is confirmed whether a sending agency is in the 
management range. At step S626, when the receiver's address is specified, an output tray is 
chosen corresponding to the receiver's address. When the receiver's address is not specified but 
only the sending agency is specified, an output tray is chosen corresponding to a sending 
agency. As shown in (a) of drawing 63 R> 3, the information on receivers address or sending 
origin is expressed on a corresponding output tray as step S627. Or as shown in (b) of drawing 
63 , the information on receiver's address or sending origin and the location of an output tray are 
displayed on a common-display screen. If the user is beforehand set up for every output tray at 
this time, it becomes an output tray only for users, and if it does not set up especially, the user 
of each output tray will change if needed. 

[0192] Printing is performed at step S628. It is confirmed whether, at step S629, a sending 
agency is in the management range by completing printing. At step S630, it notifies that printing 
was completed to a sending agency. It is confirmed whether at step S631, a fixed time amount 
document remains and a sending agency is in the management range. At step S632, it notifies 
that the printed document remains in the sending agency for a long time. 

[0193] [Operation gestalt 23] The information about time amount is dealt with with this operation 
gestalt Drawing 65 is drawing showing the functional configuration of the system of this 
operation gestalt The processing section 650 was equipped with the understanding section 652, 
the planning section 653, the activation section 654, the response section 655, and the 
knowledge base 656, and has connected with a database 651. 

[0194] Drawing 64 is the flow of overall processing of this operation gestalt, and flow-chart-izes 
procedure in the functional configuration of drawing 65 . 

[0195] At step S640, it investigates whether there is any input from the outside, and if it is, he 
will analyze the text inputted by the understanding section 652 at step S641 with reference to 
the knowledge base 656 per a word or sentence, and will analyze and understand the object of 
the content of an input by step S643 further. If it judges whether information required for the 
target understanding is insufficient and there is lack at step S644, it will ask to a user at step 
S645, the reply from a user will be learned to the knowledge base 656, and it will return to step 
S643. If there is no lack, it will progress to step S646. Moreover, at step S640, if there is no 
input, the work which should be performed will be found out by step S642, and it progresses to 
step S646. 

[0196] At step S646, the planning section 653 performs the planning for attaining the object At 
step S647, if it judges whether information required for a planning is insufficient and there is lack, 
it will ask to a user at step S648, the reply from a user will be learned to the knowledge base 
656, and it will return to step S646. If there is no lack, a plan will be performed by the activation 
section 654 at step S649. At this time, if needed, a database 651 is accessed or the activation 
section 654 communicates with other applications. And the content is determined when judging 
whether a response should be performed at step S650 by the response section 655. 
Furthermore, at step S651, the response corresponding to the determined content is created 
and a user is answered. 

[0197] if , when it have recognize to the information inputted from the outside , for example , a 
keyboard entry , voice input , E-mail and FAX , news information , etc. , the understanding 
section 652 analyze the content , analyze a time concept from the language in a text , and it 
understand the content of the text which have involvement in time amount . 
[0198] Drawing 67 is drawing showing the example which extracts schedule information from an 
electronic mail. Above-mentioned processing analyzes the content of the document received by 
E-mail, as specifically shown in drawing 67 . The time concept of "February 22", "13:30", and 
"15:00" is found out and analyzed, and the patent system explanation meeting is planned in B 
conference room from [ which has involvement in this concept / text "/ on February 22 ] 13:30 
to 15:00. " — by understanding, it becomes possible to match the action relevant to time 
amount with a schedule. 

[0199] Moreover, the'time concept and current time which were analyzed are compared, if it is 
the time of day of the future, the action will be registered into a schedule, if it is description 
about the past time of day, without registering with a schedule, it will cancel or an individual 



database etc. will be registered as information on classes other than a schedule as record of the 
past occurrence. 

[0200] Moreover, the information as which the understanding section 652 was inputted from the 
outside, for example, keyboard entry, The contents, such as voice input, E-mail and FAX, and 
news information, are analyzed. When a plan without the language (a word, concept, etc.) which a 
system does not know yet in the language in a text, or having performed etc. is discovered When 
there is no urgency in the language and plan, it learns by finding the information in connection 
with the language and plan one by one, and stores in the knowledge base 656 as information. 
[0201] It is memorizing something that is called XYZ existing, when the language which is not 
known "XYZ" comes out, and then specifically analyzing the text XYZ's being "dramatically 
delicious", "XYZ's being hard", etc., and XYZ is hard and delicious food. It learns. 
[0202] [f a user understands it as the plan at the time of an absence from the situation at that 
time, for example when the first plan is directed also about a plan, it will learn as an example of 
how to stand the plan at the time of a user absence. 

[0203] Furthermore, the system which is reporting the action and the plan which the system 
performed to the user each time when the information in connection with a user is acquired from 
news etc. is received. It is not necessary to carry out a report of this information from a degree, 
a user — a report — the carrier beam time — " — By taking out directions with the natural 
language " etc. to a system, a system can also be learned so that the information may not be 
reported. 

[0204] As mentioned above, in this system, the content of the information inputted from the 
outside is analyzed in the understanding section 652, the object is analyzed, and in order to 
attain the object in the planning section 653, the plan of the action which a system must perform 
is stood. And processing is performed in the activation section 654. Moreover, the response 
section 655 informs a user of the performed processing. 

[0205] For example, when it is understood in an individual database from the addressers 
information at a carrier beam case that E-mail which is shown in drawing 67 is mail from a non- 
registered partner, the information about the man is extracted from e-mail, and it registers with 
the individual database of a database 651. Furthermore, also when the information about a non- 
registered person is in an individual database in addition to it, you may make it register with an 
individual database. 

[0206] Moreover, by understanding that e-mail is advice of an explanation meeting, it accesses 
at the schedule of the user of a database 651, and time amount with the existing schedule data 
is matched. When there were no problems, such as a collision with the existing schedule data, in 
new schedule data and a problem is discovered as drawin g 69 R> 9 shows this data, although 
additional registration of the schedule is carried out, the report to the answer and user to a 
transmitting agency is created. 

[0207] Thus, by understanding the content from the received information, this system makes the 
response which a system should perform according to a situation, and is performed. 
[0208] In addition, although processing in which an answer was created and returned to the 
partner who has sent E-mail, without a system checking to a user was performed in the above- 
mentioned explanation, this is the action performed from the result of the text "connect the 
more inconvenient one urgently" being in a document, and having analyzed this since it judged 
that the urgency of a response was high. Here, when the holding schedule was quite previous 
time, or it is a meeting of arbitration participation etc. and it is judged that the urgency of a 
response is low, it opts for the action performed according to an urgency, such as checking to a 
user in advance of a response. 

[0209] Moreover, it is possible like the directions from the user by natural language to access 
and answer a schedule, an individual database, etc. to the natural language input from a user. 
[0210] for example, — " — whom — that the telephone number of that accesses an individual 
database by asking a question what No. ?" with natural language **** — " — the board on the 
16th is where — it is possible by receiving a question with natural language as ?" to access a 
schedule and to reply to a user. 

[021 1] Drawing 66 is drawing showing the class [ exterior / which perform overall processing of 



this operation gestalt / the system and the exterior ] of I/O. 

[0212] As an input, it can input from a keyboard or the voice inputted from the natural language 
information received as an electronic mail or the document inputted as an image from a scanner, 
an image, a microphone, etc., the image inputted from a camera can be treated. The input of 
natural language can be acquired by performing character recognition processing to the 
document read with the scanner, and performing speech recognition processing to voice. 
[0213] In an input, those (Idle) without an input look for the work which the system itself should 
perform, when anything does not have an input from the outside, as step S642 of drawing 64 R> 
4 showed, and they are taken as an input. For example, when it is an idle state without the given 
work, news are accessed, and it goes to take oneself the information which has involvement to a 
user, and considers as input. 

[0214] Moreover, as an output, they are the registration to databases, such as a schedule, filing 
in a file storage unit, or deletion of data. Furthermore, there are advice to a user, answerback to 
a transmitting agency, etc. That an important thing can make judgment that it cannot process in 
the range of an understanding of a system, and carries out the response of the purport which is 
not made with an output etc. is the point which can perform other actions, when processing is 
impossible. 

[0215] Moreover, as a partner of I/O, there are other processing sections or another 
applications inside the equipment of a user or the exterior or a system etc. 
[0216] Moreover, while close analyzes the document to which it came, carries out data 
extraction of the information about people, and the information about time amount and stores 
them in a personal data base or schedule data, information required to guess action expected is 
also extracted and it is used by planning. 

[0217] Close came by the example of drawing 67 . E-mail As description concerning people as a 

To : toshima@abc. canon. co. jp, 

rohradabc.canon.co.jp, 

kazuyoftabc. canon, co. jp 

^r,. , A From: ichjroSabc.canon.co.jp 

result of analyzing a document, 

He is Suzuki of a system intellectual property propulsion division. 

Suzuki (ichiro@abc.canon.co.jp) 044-549-6312 Canon (extension 620-5151) Co., Ltd. — The 
intellectual-property headquarters system intellectual property propulsion division exists, among 
these the person whose mail address is "kazuyo@abc.canon.co.jp" is registered in an individual 
database, supposing other persons have not registered, the information on PERSON 1, 2, and 3 
will be extracted from there like drawing 67 , and they will be registered into a database 651. 
[0218] On the other hand, as description of the information about time amount, since "the 
patent system explanation meeting is planned from [ on February 22 ] 13:30 to 15:00 in B 
conference room" exists, the information on EVENT1 is extracted from there. 
[0219] Furthermore, as description used for guessing action expected, since "connect the more 
inconvenient one urgently" exists, it is used by the processing explained henceforth [ drawing 
70]. 

[0220] Drawing 68 is the flow chart with which the part required for origin was extracted [ the 
flow of the processing for performing processing of drawing 67 and drawing 69 ] for the flow 
chart of drawing 64 , and the executive operation step S649 was expressed more concretely. 
[0221] According to drawing 67 and the flow of 69, it explains concretely below. 
[0222] At step S680, if there is an input of E-mail, the inputted E-mail document will be analyzed 
for every word or sentence by step S681. At step S683, he understands "there is people's 
information" and there "there being an event called an explanation meeting" from a signature 
and a header. Furthermore, he understands "an answer is required at the time of 
inconvenience." 

[0223] People's information is extracted and the plan registered into a database and the plan to 
register an explanation meeting event into a schedule are built at step S684. An activation plan 
exists at step S685. At step S686, since it is satisfactory, processing is passed to step S688. At 



step S688, people's information is extracted, and it registers with a database, and returns to step 
S685. 

[0224] In the case of drawing 67 , the activation plan to register an explanation meeting event 
into a schedule exists at step S685. At step S686 t since this event can be registered into a 
schedule without a problem, it passes processing to step S688. A schedule is registered at step 
S688. If it returns to step S685, since there is also no advice sentence at step S689 by there 
being no activation plan, processing will be ended. 

[0225] In the case of drawing 69 , the activation plan to register an explanation meeting event 
into a schedule exists at step S685. The collision of a schedule is discovered at step S686. 
Since there is a problem in activation of a plan, since it is inconvenient, a plan is reorganized at 
step S687 so that an answer may be reported to delivery and a user. The plan to write an 
answer and to transmit at step S685 exists. At step S686, since it is satisfactory to activation of 
a plan, it is step S688, and convenience draws up the document of a bad purport and transmits a 
reply document to the partner of a transmitting agency. At step S685, the document preparation 
plan for advice of a user exists. At step S686, it is satisfactory to activation, and is step S688, 
and the document which notifies a user of having sent the answer which asks you for 
reconsideration by the content of the E-mail and schedule collision is drawn up. At step S685, 
there is nothing, an activation plan is step S689, since it has an advice sentence, a user is 
suitably notified of it, and it ends processing. 

[0226] Schedule information by which data extraction was carried out in the example of drawing 
69 EVENT1 Schedule planned from before As a result of comparing EVENT2, it turns out that 
the schedule has lapped. Furthermore, according to the information extracted in the example of 
d rawing 69 , when inconvenient, it also turns out that it must connect So, in the system using 
this operation gestalt, using the information of letter creation, since the schedule has lapped, the 
letter which tells the purport that a board cannot be attended is created and an answer is 
transmitted automatically. 

[0227] Furthermore, the user of the system using this operation gestalt is notified of the system 
using this operation gestalt having sent the answer automatically. 

[0228] [Operation gestalt 24] Drawing 70 is drawing showing an example when a user questions 
the system of this operation gestalt with voice. 

[0229] If a user asks a question "********? which does tomorrow's board where" with voice, a 
system can answer the location of a board with reference to a user s schedule information. 
Furthermore, explanation is performed, creating an explanation story and mixing graphical image 
and voice, after planning whether it becomes intelligible, when the way to the location where a 
board is held for a user is not found, and a question was asked "Where [ of bottom Maruko ] it 
is", and explaining to the user how further with reference to the database to it 
[0230] Drawing 71 is the flow chart with which the flow of processing of drawing 70 was 
expressed based on the basic flow chart of drawing 64 . Here, the input from the outside serves 
as a question. 

[0231] The processing to the 1st question is explained. At step S710, if voice input (********? 
which does tomorrow's board where) from the outside is performed, it will be step S711 and an 
input statement will be analyzed. At step S712, he is a question about tomorrow's board and 
understands that a user's object is getting to know the location. At step S713, in order to reply 
to a question, the following plannings are performed. ** Take out tomorrows schedule. ** 
Acquire the location registered into the schedule. ** Perform document preparation for notifying 
the acquired location. 

[0232] Although it is step S714, and processing is passed to step S716 since there is no lack of 
information in this case, since it does not know which board it is when two or more boards exist 
in a schedule, asking a user at step S715 and reorganizing a plan again will be performed. At step 
S716, the plan stood at step S713 is performed, and the document of an answer to a user is 
drawn up. It determines to reply, since the document of which a user should be notified exists at 
step S717. It is also simultaneously determined that he understands that the input was voice at 
this time, and an answer will also perform it with voice by it. At step S718, a user is notified of 
the document changed into voice data. 



[0233] Here, although processing is once ended, the question from a user is inputted 
continuously. The processing to the 2nd question is explained. 

[0234] If voice input (where [ of bottom Maruko ] is it ?) from the outside is performed at step 
S710, an input statement will be analyzed at step S711. He understands that it is the question 
which understands that it is the continuation question of the 1st question at step S712 t and asks 
the concrete location of the answered name. 

[0235] At step S713, in order to reply to a question, the following plannings are performed. ** 
The plan to acquire an image required from a plan, ** image database, and the database of a 
location for what it pours to a plan that explanation is difficult in written form, and ** image is 
poured in order, and is explained, the plan to draw up the document which doubled with ** image. 

[0236] There is no lack of information at step S714. At step S716, sequential execution of the 
plan stood at step S713 is carried out and the document of an answer to the user who doubled 
with the image is drawn up. Since the document of which a user should be notified exists at step 
S717, it determines to reply. It is also simultaneously determined to explain with voice by it, 
understanding that the input was voice at this time, and displaying an image on a monitor. A user 
is notified at step S718. The flow of the processing of a single string of drawing 70 by the above 
is ended. 

[0237] [Operation gestalt 25] When a schedule laps, the example of drawing 72 proposes to a 
user, after planning how [ of the priority of two schedules ] should be evaluated and carried out 
[0238] That is, in the case of this example, when one schedule is more important than another 
side, it is proposed that the schedule of the direction which is not comparatively important is 
canceled. 

[0239] When it has the information that a user can see off a deputy about the schedule which 
had cancellation proposed, to it, a system can perform further action united with it by replying to 
a system such. Moreover, it can also learn about the plan to see off a deputy, at this time. 
[0240] Drawing_72 is step S686 explained with the flow chart of drawing 68 , and combines other 
examples of how to stand the plan in step S646 of drawing 64 at the time of discovering the 
collision of a schedule. 

[0241] Although drawing 68 explained as processing which transmits the answer of 
inconvenience to a partner unconditionally, here explains the processing using two or more reply 
NINGU as an art of RIPURANNINGU of step S646. 

[0242] Drawing 73 is the flow chart of the processing for evaluating a priority from the content 
of the document and proposing to a user as reply NINGU at the time of a schedule collision. This 
processing is explained below. 

[0243] The priority of the schedule described above is synthetically determined from the 
attendant to the information which the user set up beforehand for every schedule, and the event 
contained in a schedule, the object of a schedule, the result analyzed from the received content 
of a document. Here, the priority determined from an attendant may be set up to a person from 
whom a user becomes an attendant beforehand. 

[0244] Moreover, a user may set up beforehand the priority determined from the object of a 
schedule, and it may be made to be determined by taking into consideration similarity with the 
object and field in which the user who learned from the past actuation is interested. That is, 
priority is given to the direction of the schedule of a computer-related event over an estate- 
related event when the user is engaged in computer-related work. Of course, priority may be 
given to the direction of the schedule of an estate-related event if the user is considering the 
purchase of a house and that is memorized as information about a user. 

[0245] On the other hand, as a priority determined from the analysis result of the content of a 
document, when the schedule of the document of the description "be sure to be present", and 
the document of the description "be present if it can do" collides, suppose that former one is 
judged that a priority is high etc., for example. 

[0246] In drawing 73 , the existing schedule information is acquired at step S730. Step S731 
estimates the priority of new schedule information. The priority of both information is measured 
at step S732. The plan to draw up the advice document (for example, for two schedules which 



collide to be shown and for it to be asked whether I may cancel about the one where a priority is 
lower) for asking a user from a comparison result at step S733 is stood. The created advice 
sentence is told to a user at step S734. At step S735, the answer from the user to an inquiry of 
a plan is obtained. Here, in order to perform a user's answer and to plan a users answer again as 
an input, the same processing as answer RIPURANNINGU of drawing 68 is performed ( drawing 
74). 

[0247] Drawing 74 is the flow chart of processing of above-mentioned RIPURANNINGU. 
[0248] The answer eventually obtained by drawing 73 at step S740 is given to an input An 
input-statement document is analyzed at step S741. At step S742, he understands that they are 
modification of a schedule, and the first directions plan. 

[0249] The following plans are stood at step S743. (a) Change a schedule, (b) Draw up the 
document for notifying an acting man. (c) Learn a new plan, (d) Draw up the document of which a 
user is notified, (e) Notify that it remembers and there is a schedule. 

[0250] At step S744, the plan stood at step S743 is performed, (a) Change a schedule, (b) Draw 
up and notify the document for notifying an acting man. (c) Learn the plan to order an agent (d) 
Add to a creation document that draw up the document for notifying a user, it (e) Remembers, 
and there is a schedule. 

[0251] At step S745, the advice sentence to a user is told to a user. Above, explanation of the 
processing for performing processing of drawing 72 is ended. 

[0252] [Operation gestalt 26] Drawing 75 is drawing showing a whole image also including I/O of 
the system of this operation gestalt. Drawing 76 is a flow chart showing the flow of processing of 
the whole system of drawing 75 . 

[0253] The information inputted from various input devices, such as E-mail, voice, keyboard 
entry, WWW, a telephone, FAX, a scanner, and a camera All are analyzed in the input 
Management section 751 (step S760). In the Core section 752 After understanding the content 
arid planning suitable processing (step S761), by the output Management section 753 After 
determining output media and making preparations of the content of an output, or an output path 
(step S762), it is outputted from various output equipment, such as E-mail, voice, WWW, a 
telephone, FAX, a printer, and a copy machine. 

[0254] Drawing 77 -79 are the flow chart with which step S760 (processing of the input 
Management section 751) which is each step of the whole drawing 76 flow chart, step S761 
(processing of the Core section 752), and step S762 (processing of the output Management 
section 753) were expressed concretely. 

[0255] In drawing 77 , the input Management section 751 is step S770, and waits for a new input 
The information inputted at step S771 is acquired. At step S772, analysis processing of the 
acquired input is performed, when it has recognized, if . At this time, the input Management 
section 751 can receive information from various media, is an approach according to each media, 
and performs recognition and analysis. 

[0256] In drawing 78 , the Core section 752 performs receipt processing for the input analyzed 
by drawing 77 . 

[0257] At step S780, he analyzes and understands the object of input from an analysis result. At 
step S781, it investigates how the object of input is related to itselves (a system, user). That 
planning which should perform what from its relation at step S782 according to the object is 
performed. At step S783, the plan made from step S782 is performed. 

[0258] In drawing 79 , if the output Management section 753 determines whether it is necessary 
to carry out a response from the result performed by drawing 78 and has the need, it will create 
and output a response. 

[0259] At step S790, analysis of the result performed by drawing 78 is performed. At step S791, 
it judges whether the response to the performed result occurs. If there is nothing, processing will 
be ended as it is. When a response occurs, it is determined whether what we do with the 
response to the response from the outside at step S792. The media which perform a response 
are determined at step S793. The response doubled with the determined media is created at 
step S794. The response created at step S795 is published according to media. At step S796, a 
response is outputted physically actually. The above is processing showing the whole drawing 75 



image. 

[0260] For example, when E-mail which tells a user about holding of a board arrives, input is first 
analyzed in the procedure of drawing 77 by the input Management section 751. From this result, 
in the procedure of drawing 78 , it is planned how a user and a system should correspond and 
the Core section 752 processes it the result is passed to the output Management section 753, 
processing is performed by the procedure of drawing 79 , and a response should be carried out - 
- ** — when planned, a response is performed actually. 

[0261] Here, it is step s782, and since it will be planned if it is required to notify a user positively 
depending on the content of the board and the situation of the schedule of the user before it 
which were told by E-mail, a response is needed. Therefore, it is judged as those with a response 
at step s791. The content which carries out a response is determined at step s792. For example, 
when the schedule has collided, selection of one of schedules is urged or, in the board which is 
not understood whether it should participate or not, the content itself which carries out a 
response, such as asking the decision, is determined here. Then, in step s793, the media which 
can tell most effectively the content of the response for which it opted above are determined. 
For example, if a user is in a going-out place, the media of which the user of going-out places, 
such as a telephone and FAX, can also be notified are chosen, and if it is the midst which is 
using the personal computer etc. for reverse, media, such as a personal computer which can 
display various data effectively, will be chosen. Then, in steps s794 and s795, according to the 
content and media which were determined above, a document and an image are created, and a 
response is created and published by the approach of being further changed into natural 
language voice depending on media. 

[0262] Drawing 80 is a flow chart for explaining how data are extracted from the information still 
more detailed and inputted [ the overall flow of drawing 75 ]. 

[0263] By the system using this operation gestalt, when a document is inputted, with reference 
to notations for classification distinction, such as a layout of a document, and a bar code, the 
type of a document is first guessed at step S801. Consequently, if a document can guess a 
letter, a report, a patent official report, etc. and it cannot progress and guess to step S803, it 
progresses to step S810, perfect OCR is performed, and a document type is decided. 
[0264] At step S803, by OCR, in order that the guessed document type may check whether it is 
the right, OCR of the block characteristic of checking a document type is carried out, and it is 
interpreted (refer to drawing 82 ). Consequently, at step S804, the destination of a letter, the 
patent number of a patent official report, etc. are known, and a document type is checked. If in 
agreement [ with the document type which this checked document type guessed ] and it is not 
[ it progresses to step S806 and ] in agreement with it, it progresses to step S810. For example, 
if it is the electronic forms with which the character string which expresses the class of 
document to a part for the upper part of a form is printed, document type decision is easy by 
carrying out OCR of the upper part of the form. 

[0265] At step S806, a specific block is read by OCR using the knowledge base of the document 
type by which the check was carried out [ above-mentioned ], and it interprets, and checks 
[ whether the information related to the information acquired as a result at step S807 existed in 
the past, and ], when it exists, it progresses to step S808, and when it does not exist, it 
progresses to step S810. Consequently, the destination, a patent number, etc. are known and it 
is understood whether it is the answer of the letter sent in the past 

[0266] At step S808, the object is judged from the content of the text which becomes important 
for origin about the situation by which an understanding was carried out [ above-mentioned ] 
etc., and it opts for the processing performed at step S809. 

[0267] At step S811, an analytical range is extended and analyzed from the object understood 
above in the range in which OCR of others is not carried out, and processing is performed 
actually henceforth [ step S812 ]. Consequently, processing of filing etc. will be performed if 
required. 

[0268] Since OCR can be performed by the above-mentioned processing, guessing the content, 
it becomes possible obtaining an efficient exact OCR result rather than performing perfect OCR 
suddenly like before, and processing to which it is carried out based on an OCR result can also 



be performed correctly. 

[0269] Drawin g 81 is drawing showing the letter set as the object of data extraction processing / 
example of fax. 

[0270] In this example, the type of a document is guessed from the layout of a document at step 
S801. Consequently, it becomes a DocTypel = letter / fax. 

[0271] On the other hand, a specific block is read and interpreted by OCR at step S803. (Refer 
to draw ing 82 ) Consequently, From, To, Dear Sir, etc. are obtained and it is checked with a 
DocType2= letter / fax at step S804. 

[0272] Specific block reading by OCR explained at step S803 of drawing 80 is explained 
concretely. Drawing 82 R> 2 is drawing explaining this processing. 
[0273] tn the system using this operation gestalt, scanning is performed as follows. 
** Read into a high speed by the PURISU can with low resolution. 

** Compare the read informational form with the form information currently stored in DB823, 
and when in agreement, read only the information inputted in addition to form, or the information 
on the field (for example, part within the limit on the card of drawing 82 ) specified for every form 
with high resolution. 

** Analyze only the field read above as an object of OCR, and continue processing. 
[0274] Furthermore, since the possibility of the form with the same document which it is going to 
read with the fixed time interval since it assumes that two or more cards of the same form exist 
in this example is high, it processes as a thing of the same form first, and re-analysis is 
performed as that from which form differs only after conflict occurs. 

[0275] By this, an analytical range is limited, an analysis domain is pinpointed by moreover 
specifying form with the large improvement in processing speed, and the large improvement in 
analysis precision is attained. 

[0276] Decision of the object from a content etc. explained at step S808 of drawing 80 is 
explained concretely. 

[0277] In the system using this operation gestalt, decision of processing is performed by the 
procedure of drawing 83 with reference to the data of the date. The following processing is 
performed when an informer is a user. 
** When the date is today, judge that it transmits by FAX. 

** When the date is before yesterday, ask a user whether the before same document was sent 
and whether the same content has been seen, and judge whether it is the mistake of filing, 
retransmission of message, and a user. 

** When the date is after tomorrow, hold till the day specified as the date, or ask whether to be 
a user's mistake. 

[0278] When the document of drawing 81 was made into the example, Datel is made into the 
date of a document and Date2 is specifically made into today s date, ** Datel = November 25, 
1996 & Date2 = November 25, 1996 - Document **** ** Datel = November 25, 1996 & Date2 = 
July 2, 1997 - File ** Datel = November 25, 1995 & Date2 = November 26, 1996 Contents date 
= December 18, 1996, 22 days - Mistake [0279] Drawing 83 is an example of the flow chart of 
processing which analyzes the object from the inputted document If a document is inputted, it is 
judged that it is the document which the document which the transmitting person had it judged 
at step s830 whether you were a user, and was inputted in other than a user received, it will be 
step s831, the objects, such as filing and data extraction, will be probed corresponding to it, and 
it will end. 

[0280] On the other hand, when a transmitting person is a user, in order to analyze further what 
kind of document the inputted document is, it progresses after step s832. The date of a 
document and today's date are compared by step s833, and when it is confirmed whether the 
document was before transmitted at step s835 when the date was near and it has not 
transmitted, it is determined that the object is "transmission of a document" Moreover, in the 
case of the document transmitted before, it is step s843 and the objects, such as filing and 
retransmission of message, are probed corresponding to it. 

[0281] It is confirmed whether on the other hand, when the date of a document was quite a 
former thing, it progressed and transmitted to step s836, and when it is the transmitted 



document similarly it progresses to step s843. When having not transmitted, it progresses to 
step s837 and it is confirmed whether the other date is indicated from the information in a 
document When the date is found, similarly it progresses to step s843. It is judged that the date 
may have mistaken, although transmission of a document can be considered as an object when 
there is no date. 

[0282] Moreover, when it is confirmed whether there is any other publication of the date from 
the information in a document at step s840 when the date of a document is quite [ date / 
current ] a previous thing and the date is found at step s841, it is determined that the object is 
"transmission of a document" When there is no date, it progresses to step s839. 
[0283] [Operation gestalt 27] Drawin g 84 is drawing showing one of the examples of the 
structure of a system which used this operation gestalt In this example, a system operates like 
the present FAX. 

[0284] However, according to the system of this operation gestalt without a user specifying a 
transmission place, from the information on the bar code given to the read document, or a cover 
sheet the transmission place of a document is judged and it can transmit to a suitable 
transmission place. 

[0285] By this, information will be sent suitable for a printer, and FAX, E-mail and WWW. 
[0286] [Operation gestalt 28] Drawing 85 is drawing showing one of the examples of the 
structure of a system which used this operation gestalt. In this example, a system realizes the 
function of a desk sorter to process all the documents on a desk. 

[0287] That is, according to the content of the read document a classification, filing, scheduling, 
other data extraction, and automatic activation of processing are performed. 
[0288] [Operation gestalt 29] Drawing 86 explains to a detail further the system explained by 
drawing 85 . Based on drawing 86 R> 6, procedure is concretely explained according to the flow 
chart of drawing 87 . 

[0289] Drawin g 87 is a flow chart showing the procedure of this operation gestalt Drawin g 88 
ar, d drawing 89 express the information used during this processing, and drawin g 88 expresses 
the information of the common knowledge base. Drawing 89 expresses the information of the 
knowledge base of the field specified as the cover page. The character string contained in the 
document inputted with reference to the information defined by drawin g 88 and drawing 89 with 
this operation gestalt is compared with the character string defined by the column of the 
character string in drawing, and it analyzes by acquiring the concept of the congruous items, 
Role which specifies the semantics further, Condition which specifies the information which 
follows, or the directed processing Action. 

[0290] In drawing 87 , at step S870, a cover page is scanned and OCR processing is performed. 
At step S871, information, such as a name of a transmitting person and an addressee, the 
telephone number, and a FAX number, is extracted with reference to the knowledge base of 
drawi ng 88 . The extracted information is registered into a database at step S872. For example, 
the cover page of a document which received in the example of drawing 86 "To : The character 
string Macrohard Corp." is contained. Then, the item "To" which is in agreement as compared 
with the item defined as the column of the character string of drawing 88 is discovered, and 
since the Role is a receiving firm name or a name, "Macrohard Corp." is extracted as an 
addressee's information. 

[0291] At step S873, actions and JOB(s), such as the advice approach, a means and a filing 
activity, and a location, are taken out from the knowledge base of the field specified as the cover 
page of d rawing 89 . For example, the cover page of a document which received in the example 
of drawing 86 "File : A character string called MH/Contract" is contained. Then, the item "File" 
which is in agreement as compared with the item defined as the column of the character string 
of drawing 89 is discovered, as directed action, filing is taken out and "MH/Contract" is 
extracted out of a document as information on a filing location. 

[0292] Here, it is on Datel = November 25, 1996. Supposing it is on & Date2 = November 25, 
1996, as explained per drawing 83 , it will be judged as object-document ****. 
[0293] At step S874, it checks whether action for the object of this processing exists. At step 
S875, action transmitted since it is the object to transmit a document to a partner is performed. 



It judges whether at step S876, there is any need for filing from the information on a cover page. 
At step S877, since there is need in the example of drawin g 86 , it files in "MH/Contract" which 
is the directed location. 

[0294] At step S878, it judges whether it is necessary to notify a transmitting person from the 
information on a cover page like step S876. Since notifying a transmitting person with voice is 
directed, a transmitting person is notified of having transmitted the document to the partner at 
step S879 with voice. At step S880, it judges whether other actions occur. In step S881 f since 
there is keyword assignment, an index is created by keyword called ABC. 
[0295] [Operation gestalt 30] Drawing 90 is drawing showing the example which refers to the 
hysteresis performed in the past based on directions by the natural language by which voice 
input was carried out, and performs processing. Based on drawing 90 , processing is explained 
according to the flow chart of drawing 91 . 

[0296] Drawing 91 is a flow chart which shows the flow of processing of this operation gestalt 
From a user, with voice, if the directions "Fax Contract again to John.Notify him by Phone/' are 
received, this system will analyze the object of directions by the received natural language, and 
he will understand "broadcasting a document called Contract again to John by FAX, and telling 
arrival by telephone." Then, in order to specify Document Contract and the transmission place 
John concretely and to perform processing, the flow of drawing 91 is performed. 
[0297] At step s910, since transmission is performed before, retransmission of message acquires 
hysteresis information from a database. Consequently, Documents Contract and John are 
specified from hysteresis information. At step S911, it is from a personal data base. John The 
destination is acquired. Although a transmission place cannot be specified in the database if it is 
original since two persons' John called John Smith and John Bush exists, it is having referred to 
hysteresis information at step s910, and before, it becomes clear that John which sent 
Document Contract is John Smith, and a transmission place is specified. At step S912, the 
"Contract" document is acquired from a filing database. At step S913, it is a transmission place. 
John A document is transmitted. At step S914, since there are advice directions "Notify him by 
Phone", it is judged that there is the need for advice. At step S915, like drawing 89 , it directs to 
FAX901 of a transmission place from the rule of the knowledge base so that advice may be given 
to an addressee by telephone. At step S91 6, since action the outside of it is not directed, it ends 
processing, 

[0298] Furthermore, FAX901 which received the document notifies having received the 
document from Mr.Doors to John by telephone according to the above-mentioned advice 
directions. In addition, when FAX901 cannot notify by telephone, it may be made to carry out by 
being a transmitting agency. 

[0299] [the operation gestalt 31] — the content of the input-statement document to the user 
by whom drawing 95 was analyzed should perform something — ** — after judging and asking a 
user actually, it is the flow chart of the example which carried out automatic activation of the 
required processing. Drawing 92 is drawing showing the example of an input-statement 
document. Drawing 93 is drawing showing the content of the conversation of a system and a 
user. Drawing 94 is the output-statement document which the system drew up, judging from the 
conversation of drawing 93 . 

[0300] Based on the flow chart of drawing 95 , processing until it draws up the output-statement 
document of drawing 94 from the input-statement document of drawing 92 R> 2 is explained. 
[0301] At step S950, he analyzes the input-statement document of drawing 92 , and understands 
the following objects, (a) John Smith him — arrive in Yokohama at 3:00 on November 28. (b) 
John Smith him — poor at Japanese, (c) I want you to pick up at a station. 
[0302] At step S951, it judges whether a user should perform something from the understood 
content Here, since it judges that it must go to invite to a station, it moves to step S952. At 
step S952, it judges whether a it (system) can perform in a deputy. Here, since a system cannot 
go to greet by oneself, it moves to step S953. At step S953, it judges whether it is necessary to 
ask a user or not, and progresses to step S954. From the destination of the document inputted 
in this example Aruna Rohra Since it is judged that it is a request of addressing to him, it moves 
to step S954. 



[0303] At step S954, it asks by doing the activity for asking a user (Mr. Aruna Rohra). Although it 
must go by this example to make Mr. John a user from the result understood at step s951, it is 
asked to the user how it should be coped with. It judges what is performed next from the asked 
result at step S955, and judges whether it is necessary to take action or not. In this example, 
since the user is directing so that it may order going to invite to Mr. Tanaka, he takes action 
according to those directions. Therefore, since the need of ordering whether I being able to ask 
of Mr. Tanaka instead here came out, it is judged that it is necessary to take action. At step 
S956, document preparation for asking a deputy of Mr. Tanaka and communication are 
performed. Here, the document for electronic mails is drawn up and it transmits. In this example, 
since it says that the information that Mr. John will arrive on the 28th, directions of wanting you 
to pick up instead of a user, and the document of an original copy that became the origin of this 
request are attached, automatic creation of the document is carried out 
[0304] The flow of the processing for above carrying out the matter (here, that is it going for 
welcoming to a station) from which a user has to take action actually from an input-statement 
document was explained. 

[0305] [Operation gestalt 32] Drawing 96 is drawing showing the operation gestalt which 
operates a system with remote control. 

[0306] According to the system of this operation gestalt, each other can be specified as each 
other by communicating directly [ a device and remote control ] or indirectly. Thereby, a function 
called high UI of a degree of freedom corresponding [ actuation according the capacity of ** 
automatic device specification and ** device to UI (user interface) of the acquisition from a 
device and ** device proper and ** voice and ** basic operation ] to UI of community and ** 
user proper and ** situation to all devices is realized. 

[0307] That is, the device for actuation is automatically recognized only by turning ** remote 
control to the device for actuation. ** Acquire the information for every device from the device 
itself through IrDA or wireless LAN. ** While realizing UI of a device proper from the information 
for every acquired device and enabling actuation with ** voice ** It is realizing common basic 
operation by making fundamental actuation operational with the same remote control, and 
referring to ** user's identification information. It acquires required information from a database 
or an address book for every user, and it not only realizes UI of a user proper, but realizes 
optimal UI according to ** situation. 

[0308] At drawing 96 , by turning remote control 960 to FAX963, model identification information 
is obtained from FAX963, and UI corresponding to this model is activated and is continued to 
displayed "Fax to". With a touch pen By inputting the character string "Fax to John" and 
directing to FAX963 The FAX number of John is read from the address book 965 in a personal 
computer 964, and the document with which it was specified on the file in the document set to 
FAX963 or a personal computer 964 is transmitted to the number. About this detail, it mentions 
later. 

[0309] [Operation gestalt 33] Drawing 97 is drawing showing the example of a status monitor. 
[0310] According to the system of this operation gestalt, information other than the machine 
with which the user is performing the direct control can be referred to. 
[0311] Thereby, it is ** remote. & The function in which it can respond to all the devices in 
which ** voice actuation with the function of the common I/O for seeing handicap management, 
** automatic device specification, and ** status and ** cellular phone and ** infrared I/O are 
possible is realized. That is, even if it is the location distant from the device for **, it becomes 
acquirable [ required information ]. ** Recognize the device for actuation automatically only by 
turning remote control to the device for actuation. ** realizing common basic operation by 
making fundamental actuation operational with the same remote control, and giving the function 
of a cellular phone to ** remote control — operability — improving — ** voice actuation — 
possible — carrying out — ** — a response in all the devices in which infrared I/O is possible 
is attained by using a general protocol. 

[0312] In drawing 97 , the status monitor 970 is turned to a printer 961, a copy machine 962, or 
FAX963, by inputting and directing the character string "Status" with a touch pen, status 
information can be read from the device to which the status monitor 970 was turned to the 



status monitor 970, and the user of the status monitor 970 can check the status of each device. 
Moreover, even when a persona! computer 964 is in the location which cannot receive the 
instruction from the status monitor 970 for example, status information can also be read from a 
personal computer 964 to the status monitor 970 through a network and a printer 961 by 
specifying a personal computer 964 to the printer 961 grade which can communicate through 
this personal computer 964 and network, and requiring the status. 

[0313] [Operation gestalt 34] Drawing 98 is drawing in which remote control 960 recognizing an 
object model and showing the example which reads corresponding III from the interior of remote 
control 960, and displays it It is the screen of a default where the message "turn to a machine 
to operate" was displayed on remote control in the condition of having not turned to the object 
model, like the center of drawing. 

[0314] Here, the flow of communication between remote control and an object model is 
explained. In addition, ** and ** are not indispensable at the following explanation. For example, 
the same effectiveness is realizable if the object model has always emitted the signal towards 
remote control at fixed spacing by **. Or you may make it an object model or other equipments 
detect that remote control 960 is turned to an object model from the physical relationship of 
remote control 960 and an object model. Moreover, the equipment configuration of an object 
model is seen, and remote control 960 reads the bar code given to the object model, and you 
may make it identify an object model or identify an object model by **. That is, only the 
indispensable part is illustrated in drawing 98 . 
[0315] ** A user turns remote control 960 to an object model. 

** In order to determine the timing which sends an object model recognition signal demand signal 
to an object model from remote control 960, a user touches the touch panel of remote control 
960 etc. Or it is set up so that an object model recognition signal demand signal may always be 
beforehand sent at fixed spacing. 

** Send an object model recognition signal demand signal to an object model from remote 
control 960. 

** If it is set up according to the demand of the object model recognition signal demand signal 
from remote control 960 so that an object model recognition signal may always be beforehand 
sent at fixed spacing, an object model recognition signal will be sent according to the setting out 

** The remote control 960 which received the object model recognition signal determines UI in 
accordance with the object model which a signal shows, and displays corresponding Ul currently 
stored in the remote control 960 interior. Here, although the recognition signal was made into 
every model, it is carrying out to every device, and UI from which this model also differs for 
every device can also be used. 

[0316] Remote control recognizes an object model and drawing 99 is a flow chart in the example 
which reads corresponding UI from the interior of remote control 960, and displays it which 
shows the example of processing by the side of remote control. The flow of processing by the 
side of remote control is explained. 

[0317] At step S991, it stands by until there is directions actuation of a user. The object model 
recognition signal demand signal for having an object model recognition signal sent from an 
object model at step S992 is sent by the infrared approach. At step S993, it stands by until an 
object model recognition signal is sent from an object model. UI corresponding to the received 
object model recognition signal is acquired from the memory of the interior which can refer to 
remote control 960 etc., and is expressed as step S994. 

[0318] Remote control 960 recognizes an object model and drawi ng 100 is a flow chart in the 
example which reads corresponding UI from the interior of remote control 960, and displays it 
which shows the example of processing by the side of an object model. The flow of processing 
by the side of an object model is explained. 

[0319] At step S1001, it stands by until there is a demand signal from remote control 960. At 
step S1002, an object model recognition signal is sent by approaches, such as infrared ray 
communication. 

[0320] [Operation gestalt 35] Drawing 101 is drawing in which remote control shows reception 



and the example to display for UI from an object model. The screen of a default is displayed on 
the remote control 960 in the condition of having not turned to the object model, like the center 
of d raw ing 101 . 

[0321] Here, the flow of communication between remote control and an object model is 
explained. 

[0322] In addition, ** to ** is not indispensable at the following explanation. For example, the 
same effectiveness is realizable if the object model has always emitted the signal towards 
remote control at fixed spacing by **. Or you may make it an object model or other equipments 
detect that remote control 960 is turned to an object model from the physical relationship of 
remote control 960 and an object model. Moreover, the equipment configuration of an object 
model is seen, and remote control 960 reads the bar code given to the object model, and you 
may make it identify an object model or identify an object model by **. That is, drawing 101 is 
explaining only the indispensable part. 

[0323] ** A user turns remote control 960 to an object model. 

** In order to determine the timing which sends UI demand signal to an object model from 
remote control 960, a user touches the touch panel of remote control 960 etc. Or it is set up so 
that UI demand signal may always be beforehand sent at fixed spacing. 
** Send UI demand signal to an object model from remote control 960. 

** Send UI according to a demand of UI demand signal from remote control 960. Or if it is set up 
so that UI may always be beforehand sent at fixed spacing, UI will be sent according to the 
setting out. 

** The remote control 960 which received UI displays UI. 

[0324] Drawing 102 is a flow chart with which remote control 960 shows the example of the 
processing [ in / for UI / reception and the example to display ] by the side of remote control 
from an object model. The flow of processing by the side of remote control is explained. 
[0325] At step S1021, it stands by until there is directions actuation of a user. UI demand signal 
for having UI sent from an object model at step S1022 is sent by approaches, such as infrared 
ray communication. .At step S1023, it stands by until Ut is sent from an object model. Received 
UI is expressed as step S1024. 

[0326] Drawing 103 is a flow chart with which remote control shows the example of the 
processing [ in / for UI / reception and the example to display ] by the side of an object model 
from an object model. The flow of processing by the side of an object model is explained. 
[0327] At step S1031, it stands by until there is a demand signal from remote control 960. At 
step S1032, UI is sent by approaches, such as infrared ray communication. 
[0328] [Operation gestalt 36] When UI of each device has drawing 104 in the wireless LAN 
server 1041 and UI is required towards the copy machine 962 which is an object model about 
remote control 960, it is the request from a copy machine 962 and is drawing showing the 
example as which UI is transmitted and displayed from the wireless LAN server 1041 to remote 
control 960. 

[0329] The screen of a default is displayed on the remote control 960 in the condition of having 
not turned to the object model, like the center of drawing 1 04 . 

[0330] Here, the flow of communication between remote control and an object model is 
explained. 

** A user turns remote control 960 to an object model (here, it considers as a copy machine 
962). 

** In order to determine the timing which sends UI demand signal to an object model from 
remote control 960, a user touches the touch panel of remote control 960 etc. Or it is set up so 
that UI demand signal may always be beforehand sent at fixed spacing. 

** Send UI demand signal to an object model with the remote control identification information 
(it considers as remote control A) for identifying remote control 960 self. 
** The object model which received remote control identification information and UI demand 
signal from remote control requests transmission of delivery and UI from the server 1041 which 
has managed the object model for the object model identification information (copy machine) 
which discriminates the object model itself from remote control identification information 



(remote control A). 

** A server 1041 sends UI of the model shown by object model identification information through 
wireless LAN etc. to the remote control 960 shown by remote control identification information. 
** The remote control 960 which received Ul of sent addressing to itself displays UL 
[0331] Remote control does not receive UI from an object model directly, but drawing 105 is the 
flow chart of processing by the side of remote control [ in / through wireless LAN etc. / for UI / 
reception and the example to display ]. 

[0332] The flow of processing by the side of remote control is explained. At step S1051, it 
stands by until there is directions actuation of a user. The remote control identification 
information for discriminating the remote control itself from UI demand signal for having UI sent 
to an object model at step S1052 is sent by approaches, such as infrared ray communication. At 
step S1053, it stands by until UI from where is sent. Received UI is expressed as step S1054. 
[0333] Drawing 106 is a flow chart with which remote control does not receive UI from an object 
model directly, but shows the example of the processing [ in / for UI / reception and the 
example to display ] by the side of an object model through wireless LAN etc. The flow of 
processing by the side of an object model is explained. 

[0334] At step S1061, it stands by until there is a demand signal from remote control 960. At 
step S1062, the remote control identification information received from remote control and their 
own object model identification information are transmitted to a server 1041, and transmission of 
UI is requested. 

[0335] Drawing 107 is a flow chart with which remote control does not receive Ul from an object 
model directly, but shows the example of the processing [ in / for UI / reception and the 
example to display ] by the side of a server through wireless LAN etc. The flow of processing by 
the side of a server is explained. 

[0336] At step S1071, it stands by until there is a Ul Request~to-Send signal from an object 
model. Ul of the model which object model identification information shows to the remote control 
960 which the remote control identification information received from the object model shows at 
step S1072 is sent. 

[0337] [Operation gestalt 37] When drawing 108 has Ul of each device in the wireless LAN 
server 1041 and Ul is required towards FAX963 which is an object model about remote control 
960a or 960b, UI which is the request from FAX963 and is different from the wireless LAN server 
1041 for every user to remote control 960a or 960b is drawing in which being transmitted and 
showing the example displayed. 

[0338] The screen of a default is displayed on remote control 960a or 960b in the condition of 
having not turned to the object model, like the center of drawin g 108 . This screen is common to 
remote control 960a and 960b. 

[0339] Here, the flow of communication between object models is explained to be a user, and 
remote control 960a or 960b. 

** A user turns remote control 960a or 960b to an object model. 

** In order to determine the timing which sends Ul demand signal to an object model from 
remote control 960a or 960b, a user touches the touch panel of remote control 960a or 960b 
etc. Or it is set up so that UI demand signal may always be beforehand sent at fixed spacing. 
** Send both UI demand signals for the remote control identification information (remote control 
A, remote control B) for identifying remote control 960a or the 960b itself, and the user 
identification information (an upper person, beginner) for identifying the user itself to an object 
model. 

** From remote control 960a or 960b, the object model which received remote control 
identification information, user identification information, and UI demand signal sends the object 
model identification information which identifies the object model itself with the received remote 
control identification information and user identification information to the server 1041 which has 
managed the object model. 

** A server 1041 sends Ul shown by user identification information and object model 
identification information through wireless LAN etc. to remote control 960a or 960b shown by 
remote control identification information. In the example of drawing 10808 , for the beginner, UI 



for a broadcast function with it difficult [ to use ] is not sent to a beginner, but it has sent only 
to the upper person. 

** Remote control 960a or 960b which received UI of sent addressing to itself displays UL 
[0340] Although he was trying to transmit a users level information from remote control, you 
may make it distinguish a users level from remote control in an object device or a server as user 
identification information, in the above-mentioned example, from the identification information 
which received, as the information which identifies users, such as a user name, according to an 
individual is transmitted. 

[0341] Although the above-mentioned example explained only within UI, if different user 
identification information for every user is referred to, the content of the urgent mail which 
reached the user, a schedule to tell immediately, etc. can be included in UI, and it can transmit 
to remote control. 

[0342] Drawing 1 09 is a flow chart which shows the example of processing by the side of remote 
control [ in / for UI from which remote control does not receive UI from an object model 
directly, but differs for every user through wireless LAN etc. / reception and the example to 
display ]. The flow of processing by the side of remote control is explained. 
[0343] At step S1091, it stands by until there is directions actuation of a user. The remote 
control identification information for discriminating the remote control itself from UI demand 
signal for having UI sent from an object model at step S1092 and the user identification 
information for identifying the user itself are sent by approaches, such as infrared ray 
communication. At step S1093, it stands by until UI from where is sent Received UI is expressed 
as step S 1094. 

[0344] Drawing 110 is a flow chart [ in / for UI from which remote control does not receive UI 
from an object model directly, but differs for every user through wireless LAN etc. / reception 
and the example to display ] which shows the example of processing by the side of an object 
model. The flow of processing by the side of an object model is explained. 
[0345] At step S1101, it stands by until there is a demand signal from remote control. At step 
S1 102, with the remote control identification information received from remote control, and user 
identification information, its own object model identification information is transmitted to a 
server 1041, and transmission of UI is requested. 

[0346] DrawingJLjJ, is a flow chart [ in / for UI from which remote control does not receive UI 
from an object model directly, but differs for every user through wireless LAN etc. / reception 
and the example to display ] which shows the example of processing by the side of a server. 
Moreover, drawing 1 1 2 is an example of the table having shown UI determined from an object 
model and user identification information. The flow of processing by the side of a server is 
explained. 

[0347] At step S1 11 1, it stands by until there is a UI Request-to-Send signal from an object 
model. With reference to a definition as shown in drawin g 1 1 2 , UI corresponding to object model 
identification information and user identification information is sent to the remote control which 
the remote control identification information received from the object model shows at step 
S1112. 

[0348] [Operation gestalt 38] Drawings 113 and 114 are drawings showing the example which 
realizes the function which the model for actuation before an eye does not have. The flow of 
communication between the user of this example, remote control, and an object model is 
explained. 

** A user turns remote control 960 to an object model, and specifies the function to want to 
carry out 

** The model for actuation which received the demand from remote control 960 tells the 
demand to a server 1041. 

** A server 1041 sends UI of the model corresponding to the demanded function. 
** Remote control 960 displays UI which received. 

** A user operates it according to directions of UI. In the case of this example, a user sets a 
document to send to the copy machine 962 before an eye, and directs and performs the 
destination with remote control 960. 



** Ask other devices to be for that he can do it to perform the device for actuation by itself, 
and impossible [ the thing of it ] by yourself In the case of this example, a copy machine 962 
performs reading of a document but since FAX transmission cannot be carried out, the content 
of operator guidance, such as a transmission place, is sent to FAX963 with document data. 
** FAX963 carries out FAX transmission at the transmission place which had sent document 
data specified according to directions. 

[0349] In order to determine the device which requests the function which cannot do a copy 
machine 962 by itself in the above-mentioned example, it may be made for each device to have 
the information about the function of other devices, and you may make it determine, as a result 
of asking whether the function can be performed to each device on a network. Or you may make 
it ask the server 1041 with the information of a function and a corresponding model. 
[0350] [Operation gestalt 39] In the reasons of there being an obstruction in the middle of the 
model for actuation, and remote control before an eye, drawing 1 1 5 is drawing showing the 
example which tries indirect communication in other paths, when remote control does not have a 
model for actuation, and direct communication ****. 

[0351] Here, the flow of communication between a user, remote control, and an object model is 
explained. In addition, ** to ** is not indispensable at the following explanation. For example, the 
same effectiveness is realizable if the object model has always emitted the signal towards 
remote control at fixed spacing by **. That is, only the indispensable part is illustrated in drawing 
115 . 

[0352] ** A user turns remote control 960 to an object model. 

** In order to determine the timing which sends UI demand signal to an object model from 

remote control 960, a user touches the touch panel of remote control 960 etc. Or it is set up so 

that UI demand signal may always be beforehand sent at fixed spacing. 

** Send UI demand signal to an object model from remote control 960. 

** If the object device is set up according to the demand of UI demand signal from remote 

control 960 so that UI may always be beforehand sent at fixed spacing, it will send UI according 

to the setting out. 

** The remote control 960 which received UI displays UI. 

** Here, with remote control 960, when being set up so that the fixed time amount progress 
back may be spent from UI demand signal transmission and UI may be spent at fixed spacing and 
UI is not sent during more than the spacing, send UI demand signal by alternative pathway. In 
this example, when communication by the infrared signal cannot be realized, communication 
using wireless LAN is tried. 
** Display acquired UI through wireless LAN. 

[0353] In the reasons of there being an obstruction in the middle of the model for actuation, and 
remote control before an eye, drawing 116 is a flow chart which shows the example of the 
processing by the side of remote control in the example which tries indirect communication in 
other paths, when remote control does not have a model for actuation, and direct communication 
****. The flow of processing by the side of remote control is explained. At step S1 161, it stands 
by until there is directions actuation of a user. The remote control identification information for 
discriminating UI demand signal and the remote control itself for having UI sent from an object 
model at step S1 162 is sent by the infrared approach. At step S1 163, it is confirmed whether UI 
was received or not. At step S1 164, it is confirmed after demand transmission whether fixed 
time amount progress was carried out The remote control identification information for 
discriminating the remote control itself from UI demand signal for having UI sent from an object 
model at step S1165 is sent by different approaches from the dispatch path in step S1162, such 
as wireless LAN. Received UI is expressed as step S1166. 

[0354] In this case, by the wireless LAN server 1041 which received UI demand signal, although 
UI demand signal directly transmitted to the model for actuation itself will be sent to the wireless 
LAN server 1041, since the model for actuation is unknown, the menu for choosing a model 
(function) is displayed first And UI corresponding to the selected model is displayed. The 
wireless LAN server 1041 receives a model selection signal from remote control 960, and you 
may make it this UI transmit UI corresponding to that model to remote control 960, and may 



make it transmit two or more selectable UI from that menu with said menu. 
[0355] [Operation gestalt 40] Drawing 117 is drawing showing the example which saves as 
hysteresis the actuation and action which the user performed, and time of day with the 
important information in connection with it 

[0356] Here, it explains the actuation and action which the user performed, and flowing when 
saving time of day as hysteresis with the important information in connection with it 
** A user sets a document to FAX963 and directs to transmit to Mr. a of A company with a user 
(addresser) name. 

** FAX963 is a document by directions of Mr. Tom while transmitting a document according to 
directions. The data sent to Mr. a are told to a server 1041 with the sent document and sending 
time of day. 

** A server 1041 saves the received data as hysteresis information while saving the received 
document as a file [File ABC] of a suitable identifier. 

[0357] Drawin g 118 is a flow chart in the example which saves as hysteresis the actuation and 
action which the user performed, and time of day with the important information in connection 
with it which shows the example of processing by the side of remote control. The flow of 
processing by the side of remote control is explained. 

[0358] At step S1181, it stands by until there is directions actuation of a user. The remote 
control identification information for discriminating the remote control itself from the demand 
signal over the directions actuation which the user performed at step S1182, and the user 
identification information for identifying the user itself are sent by approaches, such as infrared 
ray communication. At step S1 183, it stands by until UI from where is sent Received UI is 
expressed as step S1184. 

[0359] Drawing 119 is a flow chart which shows the example of the actuation and action which 
the user performed, and the processing by the side of an object model in the example which 
saves time of day as hysteresis with the important information in connection with it The flow of 
processing by the side of an object model is explained. 

[0360] At step S1191, it stands by until there is a demand signal from remote control 960. At 
step S1192, processing corresponding to the demand signal from remote control 960 is 
performed. In the case of the example of drawing 117 , the document which the user set will be 
read and it will transmit to Mr. a of A company. At step S1 1 93, the remote control identification 
information received from remote control 960, user identification information, their own object 
model identification information, and the important information related to performed action are 
transmitted to a server 1041. In the case of the example of dr awing 117 , it is a document by 
directions of Mr. Tom. The sending document itself which is the important information in 
connection with this data for the data sent to Mr. a is transmitted to a server 1041 with sending 
time of day. 

[0361] Drawing 1 20 is a flow chart in the example which saves as hysteresis the actuation and 
action which the user performed, and time of day with the important information in connection 
with it which shows the example of processing by the side of a server. Moreover, drawing 121 is 
drawing showing an example of the updated hysteresis information as a result of this processing. 
The flow of processing by the side of a server is explained. 

[0362] At step S1201, it stands by until there is a demand signal from an object model. At step 
S1202, the important information in connection with the received data is saved. Document with 
which Mr. Tom directed transmission in the case of the example of drawing 1 1 7 File ABC It 
saves by carrying out 

[0363] At step S1203, hysteresis information is updated according to the received data, the case 
of the example of drawing 117 — Mr. Tom — 1996/7/5 — having sent the document to Mr. a of 
A company is recorded on 10:00 with the file name saved at step S1201. the data that drawing 
121 is the example of the updated hysteresis information, and Mary copied the 10 section of 
FileXYZ(s) to 1996/7/3 — 1996/7/5 — the data that Mr. Tom transmitted File ABC to Mr. a of 
A company are added to 10:00. UI that processing was completed correctly is sent to the remote 
control which the remote control identification information received from the object model shows 
at step S1204. 



[0364] [Operation gestalt 41] Fig. 122 and 123 is drawing showing the example which performed 
hysteresis and operated it to origin, after saving [ action / which the user performed / the 
actuation and action ] time of day as hysteresis with the important information in connection 
with it 

[0365] Here, after saving [ action / which the user performed / the actuation and action ] time 
of day as hysteresis with the important information in connection with it, it explains flowing when 
having performed hysteresis and operating it to origin. 

** Direct that remote control 960 shows Mr. Tom's hysteresis toward a copy machine 962. 
** A copy machine 962 tells that it shows Mr. Tom's hysteresis as the server 1041 which 
manages hysteresis based on these directions. 

** A server 1041 sets to UI only hysteresis with which Mr. Tom was concerned with reference 
to hysteresis information, send to a copy machine 962, and a copy machine 962 transmits this UI 
to remote control 960. 

** Mr. Tom chooses specific data out of the hysteresis currently displayed on remote control 
960, and he directs action. Since the data sent to A company are before needed anew in the 
case of this example, the data of "having transmitted File ABC to Mr, a of A company" tend to 
be chosen out of hysteresis, and it is going to pick out that data from the copy machine 962 in 
front of an eye by directing a "copy" as action. 

** A copy machine 962 tells directions of "copying File ABC" from a user to a server 1041. 
** A server 1041 sends a corresponding document "File ABC" to a copy machine 962. 
** A copy machine 962 prints the document received from the server 1041. 
[0366] Although he was trying to choose the data of "having transmitted File ABC to Mr. a of A 
company" out of hysteresis in the above in order that a user might pick out required data from 
the copy machine 962 in front of an eye When the name "File ABC" of a document to output is 
known, it replaces with hysteresis and the list of files is displayed, a file name can be chosen 
from the inside, or a direct file name can also be inputted. 

[0367] Moreover, it can also be aimed at the document saved at PC on a network although 
considered as the document which saved the document to take out above at the server 1041 
while transmitting by FAX963. 

[0368] D rawin g 124 is drawing showing the example of a configuration of the remote control 960 
used with the above operation gestalt 

[0369] 1241 is a display and displays with liquid crystal. Furthermore, the resistance film is 
attached to the display 1241 and information can be inputted using a pen 1242. This input may 
choose the carbon button on a screen with a pen 1242. Furthermore, a character recognition 
function can be prepared and the alphabetic character written with the pen 1242 can also be 
inputted. 

[0370] The inputted information can be transmitted to other devices from the communications 
department 1243. Moreover, the interior of equipment is equipped with the storage section 1245 
with CPU 1244 for control, and the information received from input or the communications 
department 1243, the hysteresis of actuation, etc. are memorized. A SRAM card, SIMM, HDD, 
etc. can be used as the storage section 1 245. Moreover, it is dc-battery actuation and is 
dripproof. 

[0371] Drawi ng 125 is drawing showing other examples of a configuration of the remote control 
960 used with the above operation gestalt. 

[0372] 1251 is a display and displays by liquid crystal or CRT. Furthermore, a touch panel can 
also be added to a display 1251 as an option. Thereby, information can be inputted using a finger, 
a pen, etc. 1252 is the input section which inputs information by actuation of a carbon button. 
The inputted information can be transmitted to other devices from the communications 
department 1253. Moreover, the interior of equipment is equipped with the storage section 1255 
with CPU1254 for control, and the information received from input or the communications 
department 1 253, the hysteresis of actuation, etc. are memorized. A SRAM card, SIMM, HDD, 
etc. can be used as the storage section 1 255. 

[0373] Remote control of drawing 1 25 can be used as carbon button remote control, even if it 
removes the storage section 1255. Moreover, even if it removes the communications department 



1253, it can be used as an electronic memo pad (PC). Moreover, using a touch panel, even if it 
removes the input section 1252, as shown in drawin g 124 , it can be used. 

[0374] Drawing 126 is drawing showing other examples of a configuration of the remote control 
960 used with the above operation gestalt 

[0375] 1261 is a display and displays with liquid crystal. 1262 is the input section which inputs 
information by actuation of a carbon button. The inputted information can be transmitted to 
other devices from the infrared communications department 1263. Moreover, the interior of 
equipment is equipped with the storage section 1265 with CPU1264 for control, and the 
information received from input or the infrared communications department 1263, the hysteresis 
of actuation, etc. are memorized. A SRAM card, SIMM, HDD, etc. can be used as the storage 
section 1255. Furthermore, PCMCIA slot 1266 is formed, for example, a PCMCIA card is 
inserted, it becomes connectable according to a PCMCIA bus, and two communication paths can 
be used. Moreover, the infrared communications department 1263 is only transmission by 
luminescence, and you may make it reception use a PCMCIA bus. Of course, it is not necessary 
to use connection by the PCMCIA bus. 

[0376] In addition, in the range which can realize the function of the above-mentioned operation 
gestalt, even if it applies this invention to the system which consists of two or more devices (for 
example, the body of a computer, an interface device, a display, etc.), it may be applied to the 
equipment which consists of a single device. Moreover, it aims at operating various devices so 
that the function of the operation gestalt mentioned above may be realized. To the computer in 
the equipment connected with these various devices, or a system The program code of the 
software which realizes the function of the operation gestalt mentioned above is supplied, and 
the supplied program is followed. By computer (or CPU and MPU) of the system or equipment 
What was carried out by operating said various devices is contained in the range of the invention 
in this application. Moreover, that program code itself and a means, for example, the storage 
which memorized this program code, to supply that program code to a computer will constitute 
this invention by realizing the function of the operation gestalt which the program code itself by 
which reading appearance was carried out from the storage in this case mentioned above. 
[0377] As a storage for supplying this program code, a floppy disk, a hard disk, an optical disk, a 
magneto-optic disk, CD-ROM, CD-R, a magnetic tape, the memory card of a non-volatile, ROM, 
etc. can be used, for example. 

[0378] Moreover, also when the function of the operation gestalt mentioned above by performing 
the program code which the computer read is not only realized, but it collaborates with OS 
(operating system) which is working on a computer, or other application software based on 
directions of the program code and the function of the above-mentioned operation gestalt is 
realized, it cannot be overemphasized that this program code is contained in the range of the 
invention in this application. 

[0379] Furthermore, after the program code by which reading appearance was carried out from a 
storage is written in the memory with which the functional expansion unit connected to the 
functional add-in board inserted in the computer or a computer is equipped, it is needless to say 
in being contained also when the function of the operation gestalt which performed a part or all 
of processing that the CPU with which the functional add-in board and functional expansion unit 
are equipped based on directions of the program code is actual, and mentioned above by the 
processing is realized. 

[0380] What is necessary is just to store in the storage the program code corresponding to the 
flow chart explained previously, when applying the invention in this application to the above- 
mentioned storage. 
[0381] 

[Effect of the Invention] As explained above, according to this invention, the burden of actuation 
of the user for attaining the object of processing can be mitigated, the optimal available device 
resource can be utilized, and it is effective in unnecessary or unsuitable processing being 
avoidable. 
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TECHNICAL FIELD 



[Field of the Invention] This invention relates to the information processing system to which two 
or more equipments were connected, and its approach. 
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PRIOR ART 

[Description of the Prior Art] In order to perform various processings in an environment with two 
or more available equipments, the equipment with which the user was suitable for each 
processing is chosen, and it is common to order activation of the processing corresponding to 
selected equipment 

[0003] For example, in order to transmit the information created by computer, and the 
information read with the scanner in the form recorded on the distant partner by paper, the 
partner's printer connected through a network etc. can be specified, and it can print by the 
specified printer. 
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EFFECT OF THE INVENTION 



[Effect of the Invention] As explained above, according to this invention, the burden of actuation 
of the user for attaining the object of processing can be mitigated, the optimal available device 
resource can be utilized, and it is effective in unnecessary or unsuitable processing being 
avoidable. 
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TECHNICAL PROBLEM 



[Problem(s) to be Solved by the Invention] However, in the above-mentioned Prior art, 
processing a certain directed equipment was instructed to be by failure, poor ability, etc. was not 
completed at all, or when it was not able to do thoroughly, there was a problem that the 
processing the equipment was ordered to perform could not attain as a user's object In order to 
have solved this, the user needed to check the processing result and needed to order other 
equipments anew to perform the same processing or additional processing. 
[0005] Moreover, in order to attain the object of processing, even if there was equipment more 
suitable than the equipment which the user directed, it has processed only with the equipment 
which the user directed. 

[0006] Moreover, it may be processing for a specific user depending on processing, and may be 
unnecessary or unsuitable to a current user. 

[0007] The object of this invention can solve such a conventional technical problem, can mitigate 
the burden of actuation of the user for attaining the object of processing, can utilize the optimal 
available device resource, and is to offer the information processing system which can avoid 
unnecessary or unsuitable processing, and its approach. 
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MEANS 



[Means for Solving the Problem] A receiving means to receive information to an information 
processor according to this invention in order to solve the above-mentioned technical problem, 
An analysis means to analyze the received information, and a decision means to opt for the 
processing which should be performed based on the analysis result of this analysis means, An 
activation means to perform said processing for which it opted, and a recognition means to 
recognize a situation, It has a decision means to judge whether said processing should be 
performed with said activation means based on said analysis result and said situation, and a 
termination means to stop activation of said processing by said activation means when [ which 
should be performed with this decision means ] it is judged that it does not come out 
[0009] Moreover, the receiving process which receives information to the information processing 
approach according to other modes of this invention. The analysis process which analyzes the 
received information, and the decision process which opts for the processing which should be 
performed based on the analysis result of this analysis process, The activation process which, 
performs said processing for which it opted, and the recognition process which recognizes a 
situation, It has the decision process which judges whether said processing should be performed 
according to said activation process based on said analysis result and said situation, and the 
termination process which stops activation of said processing by said activation process when 
[ which should be performed according to this decision process ] it is judged that it does not 
come out. 
[0010] 

[Embodiment of the Invention] 

[Operation gestalt 1] Drawing 1 is system configuration drawing of this operation gestalt, and 
expresses two or more equipments connected to the network. In this, in a personal computer 
(PC) and 102, a scanner and 103 express a color printer and, as for 101, 104 expresses the 
monochrome printer. 

[001 1] With this operation gestalt, in the system (when it is drawing 1 , it connects with the 
network) to which two or more equipments were connected, when activation of JOB is directed 
to a certain equipment, he understands what JOB which should analyze the object and he should 
perform from the content of JOB is. As a result of understanding, information required for JOB 
which should be performed is acquired and performed. In case JOB is performed, when there are 
technique more effective than the directed content and another equipment, processing is 
directed to other equipments or advice for proposing the technique to a user is performed. 
[0012] Moreover, it also performs refusing the directions itself depending on the content of JOB. 
Here, there is new JOB generated by itself at the activation directions from a user's alter 
operation and other devices, the result of having analyzed these JOB(s), and the time of an idling 
in the class of JOB. For example, in printing a document by another printer as reading from a 
scanner, the following JOB(s) occur. 

** The read and analysis processing of a document in which the analysis ** scanner of the 
content of the directions to a scanner analyzed and generated the directions (and thing for 
which the document was set) received from the user about the document which the user set to 
the scanner, The directions processing ** scanner to the printer for printing the read document 



generated according to directions processing, the printing processing whose printing directions 
** printer to a printer analyzed and generated the printing directions received from the scanner 
— the detail of such a generation management method of JOB is explained henceforth [ the 
operation gestalt 1 1 ]. 

[0013] Below, the procedure of performing these processings with two or more equipments is 
concretely explained based on a drawing. 

[0014] Drawin g 2 is a functional block diagram for processing this operation gestalt The JOB 
receipt section 201 receives JOB from a user or other equipments. Received JOB is registered 
into the JOB table 202. The JOB analysis section 203 takes out and analyzes JOB registered 
into the JOB table 202. The other devices information acquisition section 204 acquires an 
attribute, a current condition, etc. of other connected devices. The situation seal step 207 
judges a situation from the current condition of other devices etc. 

[0015] The optimal planning section 210 stands the optimal plan about activation of JOB. In the 
JOB activation decision section 206, when performing whether JOB is performed or not, it 
judges performing by other devices whether it performs with self-equipment etc. When 
performing by other devices, activation of JOB is directed to other devices by the directions 
section 205 to other devices. When performing with selFequipment, it performs in the JOB 
activation section 209. The advice section 21 1 of activation notifies a user of having directed 
activation to an activation result or other devices etc. 

[0016] Drawing 3 is hardware configuration drawing of each equipment for realizing processing of 
this operation gestalt. 

[0017] I/O301 performs I/O with the equipment exterior. CPU302 controls each part of 
equipment while performing a program. ROM303 memorizes a program, fixed data, etc. which 
should perform CPU302 corresponding to each flow chart mentioned later. RAM304 memorizes 
temporarily various variables generated during activation of processing, such as an attribute, a 
current condition, etc. of the JOB table 202 and other devices by which it acquired in the other 
devices information acquisition section 204, medium data, etc. Moreover, a program is loaded to 
RAM304 from the equipment exterior etc., and you may make it make it memorize. 
[0018] Drawing 4 is the flow chart which showed the flow of processing of this operation gestalt. 
First, the content of the JOB table is initialized at step S109. At step S1 10, it judges whether 
JOB was inputted by confirming whether there is new JOB generated by itself at the input JOB 
from the input JOB from a user, the device which can detect a system, the result of having 
analyzed these JOB(s), and the time of an idling. If inputted, JOB inputted into the JOB table will 
be added at step S1 11. If it investigates whether there is JOB on a JOB table and is shown in it 
at step S1 12, JOB will be taken out at step S1 13. At step S1 14, the given directions are 
analyzed and the object of JOB is analyzed from the information. At step S115, JOB which 
should be performed further is probed from the analyzed directions. At step S116, JOB probed 
at step S1 15 is registered. 

[0019] At step S1 17, it investigates whether there is non-performed JOB, and if it is, it will 
progress to step S118. At step S118, when JOB judges whether activation is possible and is 
judged to be impossible, return and JOB which must newly be performed are probed to step 
S1 1 5. At step S1 1 9, JOB is performed and it returns to step S1 1 7. 

[0020] For example, it will be analyzed, if it is a user s object that a document [ finishing / 
printing ] comes to hand when a user gives directions so that a document may be printed by 
another printer as reading from a scanner. Moreover, the read and analysis processing of a 
document in which the scanner analyzed and generated the information received from the user, 
and the directions processing to the printer for printing the read document are probed as JOB in 
this case. Explanation of such detailed flow is explained henceforth [ the operation gestalt 1 1 ] 
based on an example. 

[0021] Drawing 5 is drawing having shown the flow of the processing which chooses the optimal 
printer from two or more printers, and performs printing. 

[0022] In drawing 5 , the instruction from a host computer, an instruction of the natural language 
which the user as directions from remote control etc, emitted with voice, and the bar code or 
text read in the cover page is analyzed, and JOB information is transmitted and inputted. 



[0023] The device which received the transmitted JOB information analyzes JOB, outputs by 
choosing automatically the printer which can perform processing suitable for JOB, and when 
there are advice directions further, it chooses and notifies the optimal media according to an 
advice place. Therefore, to a demand of a user, with reference to the configuration of a printer, a 
suitable printer is chosen and printing is performed. According to a situation, it also performs 
distributing processing to two or more printers in that case. Moreover, when there are advice 
directions, the optimal media for advice are chosen and the printer name which performed 
printing, termination of printing, etc. are notified. As a demand of a user, there are a paper size, a 
quality of printed character, a color, a time limit (for example, I want to print by 5:00), etc. 
Moreover, as a configuration of a printer, there are a class of printer, the number, the engine 
performance, a current condition (normal actuation is carried out; there is a queue of the waiting 
for printing, or forms and toners are insufficient), etc. As media for advice, a users terminal, 
voice reports, tell by telephone, a message is sent to a pocket bell, or it transmits by the 
electronic mail or FAX by using the content of advice as a document 
[0024] Below, according to the flow chart of drawing 4 , the situation that each equipment 
processes processing of drawing 5 is explained. 

[0025] First, when the directions which are step S1 10, for example, are urgent and will output a 
certain document by 5:00 to a host computer are able to be given, JOB is added to a JOB table 
at step S1 1 1. At step S1 13, the directions to which JOB was given at ejection and step S114 
are analyzed, and the object of JOB is analyzed from the information. At step S1 15, following 
JOB is probed from the analyzed directions. 

[0026] ** Acquire the information (a paper size, a quality of printed character, color document, 
etc.) for choosing the printer suitable for an output from the document which should be 
outputted, and information, such as the time limit. 

** Choose the printer suitable for the information on ** from the connected printer. 

** Inspect whether the selected printer has a failure in an output. 

** Output to the printer chosen automatically. 

** Notify having performed the selected printer and the output 

[0027] At step S1 16, JOB probed at step S115 is registered. The following is repeated until it is 
judged that all probed JOB(s) were lost at step S117. At step S118, when JOB judges whether 
activation is possible and is judged to be impossible, JOB which must newly be performed is 
probed. At step S119, probed JOB is performed in order. 

[0028] [Operation gestalt 2] Drawing 6 is drawing which explains the case where a remote 
controller (remote control) is used, as an approach of directing to various devices. 
[0029] This remote control 605 is equipped with a display, only approaches devices, such as 
printers 601 and 602, and FAX603, PC604, can display the control panel and information 
corresponding to that device, and can give and control directions to that device. Furthermore, 
the device which is distantly separated from the device near the remote control 605 through a 
network is also controllable. 

[0030] Moreover, the monitor of the status of each device can be carried out, and remote 
control 605 can display it and can also acquire the status of the device on a network which 
separated distantly through the device near the remote control 605. 

[0031] [Operation gestalt 3] Dra wing 7 is drawing showing the example at the time of reading a 
document from a scanner and transmitting to a specific printer. 

[0032] After a document is read from a scanner 701, a user specifies a transmission place (using 
voice etc.). Or the transmission place is specified as the cover page and a transmission place is 
determined automatically. Thus, when it is in the condition which cannot print a transmission 
place as a transmission place as a result of acquiring the condition of ** transmission place after 
the monochrome printer A702 is determined, it transmits to another printer (for example, 
monochrome printer B703) automatically, and prints. 

** When the printer specified as a transmission place cannot print (from conditions, such as a 
color and a paper size), transmit only the page to other printers (for example, if it is a color color 
printer C704). 

** In the case of the document of large quantity pagination, print by dividing into some printers. 



** When the destination is specified as the transmission place, transmit to the destination 
automatically. 

[0033] [Operation gestalt 4] Dra wing 8 is drawing showing the example at the time of 
transmitting to the specific printer which reads a document from a scanner and cannot manage a 
scanner (by reasons of network domains differing). 

[0034] After a document is read from the scanner 701 in Austin, a user specifies a transmission 
place (using voice etc.). Or the transmission place is indicated by the cover page by the 
character string or the bar code, it is read, and a transmission place is automatically determined 
by recognition and interpreting. Thus, after the monochrome printer A702 which is in Tokyo as a 
transmission place is determined and a document is actually sent to the monochrome printer 
A702, in the case of the condition which ** monochrome printer A702 cannot print by itself, it 
transmits to another printer (monochrome printer B703), and prints. 

** When the monochrome printer A702 cannot print the document received (from conditions, like 
that a color page is included and paper sizes differ), transmit only the received whole document 
or the page which cannot be printed to other printers (for example, if it is a color color printer 
C704). 

** While the monochrome printer A702 prints by itself in the case of the document of large 
quantity pagination, print by dividing into other printers. 

** The monochrome printer A702 transmits to the destination automatically, when the 
destination is specified as itself. 

[0035] The point of difference between the operation gestalt 3 and the operation gestalt 4 has 
the printer 702 which received the document from the scanner 701 in the point of determining 
the destination, by the operation gestalt 4 to the scanner 701 having determined the 
transmission place with the operation gestalt 3. 

[0036] [Operation gestalt 5] Drawing 9 is drawing showing the example at the time of 
transmitting to the specific printer which reads a document from a scanner and cannot manage a 
scanner for the reasons of network domains differing. 

[0037] After a document is read from the scanner 701 in Austin, a user specifies a transmission 
place (using voice, a keyboard, etc.). Or the transmission place is indicated by the cover page by 
the character string or the bar code, it is read, and a transmission place is automatically 
determined by recognition and interpreting. Thus, after the monochrome printer A702 which is in 
Tokyo as a transmission place was determined and a document is actually sent to the 
monochrome printer A702, it is transmitted to the personal computer 705 in which more 
advanced processing is possible. Consequently, a personal computer 705 judges that this 
document is an urgent document (from the alphabetic character a covering letter "is urgent"), 
and if schedule data etc. show where the reception hand of a document is now, it will transmit it 
to that location (for example, Atsugi). the destination is not a printer but FAX D706 in that case 
— etc. — if media differ, media conversion will be performed and it will transmit 
[0038] [Operation gestalt 6] Drawing 10 is drawing showing the example at the time of 
transmitting to the specific printer which reads a document from a scanner and cannot manage a 
scanner for the reasons of network domains differing. 

[0039] After a document is read from the scanner 701 in Austin, a user specifies a transmission 
place (using voice etc.). Or the transmission place is indicated by the cover page by the 
character string or the bar code, it is read, and a transmission place is automatically determined 
by recognition and interpreting. Thus, after the monochrome printer A702 which is in Tokyo as a 
transmission place was determined and a document is actually sent to a printer A702, it is 
transmitted to the personal computer 705 in which more advanced processing is possible. 
Consequently, a personal computer 705 can recognize the reception hand of a document, can 
create an advice sentence, and can notify arrival of a document to the reception hand of a 
document by telephone 707. 

[0040] [Operation gestalt 7] Drawing 1 1 is drawing showing the example in the case of notifying 
the condition of a printer. 

[0041] If PC1 102 acquires the status of a printer 1 103 through a network and change of the 
status, such as an error and generating of an event is detected, according to the content, it will 



determine advice places, such as a user or a manager, and will notify using the media 
corresponding to the determined advice place. For example, notify to the terminal 1101 of a user 
or a manager by E-mail, a telephone 1104 is contacted by phone, or a message is transmitted to 
a pocket bell 1 105. 

[0042] Thereby, in the example of drawing 10 , it may replace with a telephone 707 and an 
electronic mail and a pocket bell may notify reception of a document 

[0043] [Operation gestalt 8] With this operation gestalt, when the equipment to which JOB was 
directed performs JOB by itself, it does not carry out as it is, but before performing the content 
of JOB, depending on the class and conditions of JOB, it notifies and checks at a user, or it 
cancels JOB judged to be unnecessary for a user. 

[0044] Drawing 127 is the information which specified whether an advance notification would be 

performed corresponding to the class and conditions of JOB. 

[0045] Drawing 1 2 is a flow chart showing the procedure of this operation gestalt 

[0046] First before performing directed JOB at step S120, it judges in analyzing the content 

indicated that the assignment information on the advance notification corresponding to the class 

and conditions of JOB of drawing 1 27 in whether a user should be notified of the processing to 

perform or the content is referred to, or the operation gestalt 29 explains by the cover page etc. 

When notifying in advance, the processing and the content which progress to step S1 22 from 

step S121, and are performed are notified. Furthermore, if there is need at step S123, after 

getting authorization of activation from a user, JOB will be performed at step S124. 

[0047] On the other hand, when not notifying in advance, it judges whether it is step S125 and is 

required JOB for a user, if required, JOB will be performed at step SI 27, but if unnecessary, 

JOB will be canceled at step S128. 

[0048] Next, when the content of JOB is informational filing, before a system performs 
informational filing, the content is analyzed, and the example which performs processing which 
tells a user the content is explained. 

[0049] Drawing 13 is filing processing and is drawing showing the case where the information to 
file is told to a user in advance. As for a file storage unit and 1302, 1301 is [ a scanner and 
1303 ] user terminals. 

[0050] Processing of the scanner 1302 in drawing 13 is explained according to the flow chart of 
drawing 1212 . 

[0051] At step S120, since it is JOB which files information, with reference to the assignment 
information on drawing 127 , it judges that the information filed before filing is notified, and 
information is scanned. Processing is passed to step S122 in order to notify the information to 
file at step S121. At step S122, the scanned information is notified to a user terminal 1303 
through a network. JOB of filing is performed at step S124. 

[0052] Next, when the 1st sheet is received and the content is analyzed, when there is receipt 
information, and judged as the information which is not related to a user at all, the example which 
does not receive the information after it is explained. 

[0053] Drawing 14 is drawing in the case of judging whether it is required [ from the first page ] 
in a lot of received data, or unnecessary, and canceling the information after degree page. 1401 
is a receiving side and 1402 is PC of a transmitting side. 

[0054] Processing of PC1401 in drawin g 14 is explained according to the flow chart of drawing 
12 . 

[0055] As a result of referring to the assignment information on the advance notification 
corresponding to the class and conditions of JOB of drawing 127 at step S120, since it is only 
informational reception, it is judged that an advance notification does not carry out Processing 
is passed to step S125 at step S121. Since the page of the beginning of the received information 
is analyzed and it is with "information to a general-affairs person in charge" at step S125, it is 
the information which is not related to a user, and it is judged that reception of this information 
is unnecessary. Processing is passed to step S128 at step S126. At step SI 28, while canceling 
the 1st sheet which received, processing is ended without receiving the information after the 2nd 
sheet 

[0056] [Operation gestalt 9] Drawing 1 5 is a flow chart which shows the procedure of this 



operation gestalt With this operation gestalt the equipment to which activation of processing 
was directed judges whether it should perform for equipment itself, or it should perform with 
other equipments, and directs processing to activation or other equipments in person according 
to a decision result. 

[0057] First, in step S150, if whether JOB was inputted judges and it is inputted, JOB inputted 
into the JOB table will be added at step S151. If it investigates whether there is JOB on a JOB 
table and is shown in it at step S152, JOB will be taken out at step S153. At step S154, the 
given directions are analyzed and the object of JOB is analyzed from the information. The own 
situation of equipment is judged at step S155. At step S156, the situation of other equipments 
according to the object of JOB is judged. 

[0058] If it is optimal to perform by oneself based on the situation of equipment itself and other 
equipments, it progresses to step S158 from step S157, and it will determine to perform by 
oneself and JOB will be performed by itself at step S159. On the other hand, if performing by 
oneself is not optimal and the optimal equipment according to the object of JOB exists in others, 
it will progress to step S161 from step S160, and will determine to perform JOB with equipments 
other than oneself, and activation of JOB will be directed to other equipments according to the 
object at step S162. At step S163, a user is notified of having performed JOB with equipments 
other than oneself. 

[0059] Moreover, if the equipment according to the object of JOB does not exist in others, it 
progresses to step S164 from step S160, the optimal approach which does not spoil the object 
of JOB is planned, and the plan is proposed to a user at step S165. 
[0060] Drawing 1 6 is drawing showing the information flow of this operation gestalt 
[0061] When the user of PC101 gives JOB which outputs the information inputted with the 
scanner 102 to a printer 104, it judges that given JOB cannot perform a printer 104, and a 
printer 104 finds the printer 103 which can take other equipments and communication and can 
perform given JOB, when it is a printing malfunction. ** which does not perform JOB by itself 
but is performed by the printer 103 by this is judged, and JOB is directed to a printer 103. 
Furthermore, in order to tell a user the action which he performed, it notifies to PC101. Drawing 
16 expresses this flow with an arrow head. 

[0062] Below, in processing of drawing 16 , the flow chart of drawing 15 is met and the 
procedure which each equipment processes is explained. 

[0063] First if processing of a scanner 102 is explained, at step S150, information will be 
scanned and JOB which transmits information to a printer 104 will be received. At step S151, 
this JOB is added to a JOB table, and JOB is taken out at step S1 53. He understands that it is 
JOB which scans data and transmits at step S154. It judges that there is no problem in scanning 
the information which he was operating normally and was directed and transmitting at step S155. 

[0064] At step S156, he understands that JOB cannot be turned to other equipments. At step 
S157, since performing by oneself is optimal, processing is passed to step S158. At step S158, it 
determines to scan information by oneself, information is scanned at step S159, and information 
is transmitted to a printer 104 in the path of 1 through a network. 

[0065] On the other hand, by the printer 104, JOB which outputs the received information at 
step S150 is received. At step S151, this JOB is added to a JOB table. JOB is taken out at step 
S153. At step S154, he understands outputting the information of the user of PC101 to a form 
from the received information. At step S155, the toner is lost for itself, and it is judged that it 
cannot output to a form. At step S116, it communicates and it is judged that there is a printer 
103 in which an output is possible whether there is any printer which can output the information 
otherwise received through the network (2 paths). 

[0066] At step S157, since it cannot perform by itself, processing is passed to step S160. At 
step S160, it determines to transmit the information which received JOB of outputting 
information, to the printer 103 at step S161 since it was able to perform by the printer 103. It 
directs to output the information transmitted to a printer 103 at step S162 (3 paths). It notifies 
by E-mail having performed the output directed to PC101 of the user who directed JOB at step 
S163 by the printer 103 (4 paths). Drawing 128 is drawing showing an information flow in case 



the equipment according to the object of JOB does not exist. 

[0067] When the user of PC101 gives JOB which outputs the information inputted with the 
scanner 102 to a printer 104, the printer 103 according to the object of JOB that the printer 104 
took other equipments and communication as printing with a toner piece is impossible, and the 
printer 104 was given is found, and the situation is judged, here, in order to propose to a user, it 
notifies to PC101 recovering the condition which can print printers 104 or 103 as optimal plan, 
and printing, since a printer 103 cannot be printed with a form piece, it is alike other than this 
and the printer according to the object of JOB does not exist. Drawing 1 28 expresses this flow 
with an arrow head. 

[0068] Next, in processing of drawing 1 28 , the flow chart of drawing 15 is met and the procedure 
which each equipment processes is explained. 

[0069] It is the same until a scanner 102 reads a document and transmits to a printer 104. By 
the printer 104, JOB which outputs the received information at step S150 is received. At step 
S151, this JOB is added to a JOB table. JOB is taken out at step S153. At step S154, he 
understands outputting the information of the user of PC101 to a form from the received 
information. At step S155, the toner is lost for itself, and it is judged that it cannot output to a 
form. At step S116, although it communicates, a printer 103 cannot print whether there is any 
printer which can output the information otherwise received through the network because of a 
form piece, either, and it is judged that a device suitable out of it does not exist. 
[0070] At step S157, since it cannot perform by itself, processing is passed to step S160. At 
step S160, since the device which can perform JOB of outputting information does not exist, it 
progresses to step s164. At step s164, the optimal approach for realizing printing which is the 
object of JOB of outputting information is planned. Consequently, it is planned that it is the 
optimal approach to return to normal the status of the device which can be printed. At 
continuing step s165, it proposes to a user recovering the condition which can print the printer 
104 of a toner piece, or the printer 103 of a form piece by Window as shown in drawing 129 
according to the planned result Then, change of a user's answer and the status of the printer 
itself is recognized as an input JOB, same processing is performed, and a user's object can be 
attained. 

[0071] The detail of the planning described above is explained henceforth [ the operation gestalt 
11 ] based on an example. 

[0072] [Operation gestalt 10] In processing of the operation gestalt 9 at steps S158 and S159 In 
judging that JOB is performed by itself, and performing JOB directed further, when performing 
The existence of the generating in question is analyzed in a detail like the procedure of drawing 
17 mentioned later, and when it is judged that it is not suitable to carry out JOB activation 
depending on the environment and the situation of performing JOB, a problem may be notified, or 
JOB may be refused. 

[0073] For example, the directions are refused, when there are directions of printing of a 

confidential document and it is not checked with an authorized user. 

[0074] Drawing 17 is a flow chart showing the detailed procedure of JOB activation. 

[0075] At step S170, it analyzes whether it is satisfactory to activation of directed JOB. If there 

is no problem in activation of JOB at step S171, JOB will be performed at step S175. If there is 

a problem, it will judge whether a user is notified of the generated problem at step S172, or 

activation of JOB is refused. When notifying, a problem is notified at step S174. On the other 

hand, when refusing, it is step S176, and JOB is refused and refusal is notified. 

[0076] The case where it points so that the extra sensitive information which the user of PC101 

read with the scanner 102 may be hereafter outputted to a printer 104 is explained based on 

drawing 15 and 17. Drawing 18 is drawing showing the example of the extra sensitive information 

to read. 

[0077] First with a scanner 102, at step S150, information is scanned and JOB which transmits 
information to a printer 104 is received. At step S151, this JOB is added to a JOB table. JOB is 
taken out at step S153. He understands that it is JOB which scans data and transmits at step 
S154. It judges that there is no problem in scanning the information which he was operating 
normally and was directed and transmitting at step S155. 



[0078] At step S155 t he understands that JOB cannot be turned to other equipments. At step 
S157, since performing by oneself is optimal, processing is passed to step S158. At step S158, it 
determines to scan information by oneself. 

[0079] At step S1 70, as a result of scanning information, it analyzed that it was the confidential 
document for which an output is improper. There is a problem in activation of JOB at step S171. 
At step S172, it is judged that JOB (scan and output information) is refused. At step S173, since 
JOB is refused, processing is passed to step S176. Refusal of JOB is notified at step S176. 
[0080] Moreover, similarly, when two or more users use the same system, the present user can 
be recognized from a login name etc. and directions of the output of the content other users file 
can be refused. Moreover, if the user of the destination differs from the present user also when 
a document is received from not directions but the exterior from a user, the output of an 
incoming correspondence and advice of the data of reception are refusable, or processing can 
also be suspended until the user of the destination uses a system. 

[0081] [Operation gestalt 11] The flow of processing is explained according to drawing 4 . First, a 
JOB table is initialized at step S109. It is confirmed whether, at step S110, there is any input 
from the input from a user, the device which can detect a system. Input analysis for analyzing 
the content inputted at the above-mentioned step at step S111 JOB It adds to a JOB table. It 
can perform at step S112. It confirms whether JOB exists, and if it is, it can perform at step 
S1 13. JOB is acquired. He understands the object which serves as a background which was 
going to perform JOB at step S1 14. 

[0082] At step S1 15, from the condition of the inputted content, the device which can detect a 
system, and the information which the system knows now and others, the processing which it is 
considered is planned, and if required of step S116, new JOB will be added. Step S117- By S1 19, 
processing is performed according to the content planned at step S1 15. If lost, it will return to 
step S1 1 0 repeatedly, until JOB is lost. 

[0083] A user The case where it is going to print <file A> is explained. Drawing 22 shall be 
drawing showing the content of <file A>, and the part of the picture of a vehicle shall be drawn in 
the color. Moreover, drawing 23 is drawing showing the structure of a system of this operation 
gestalt, a user performs printing directions from PC2301, the monochrome printer 2303 is set up 
as a usually used printer, and the color printer 2302 is also connected in addition to it 
[0084] JOB table initialization is carried out at step S109. JOB performed at step S111 when 
anything does not have an input is added to a JOB table (drawing 19). Moreover, drawing 20 At 
Window, it is a file name. If <file A> is specified and printing is chosen, at step S110, it will be 
judged that there is an input and it will progress to step S1 1 1. At step S1 1 1, as shown in d rawing 
21 , the input analysis JOB is added to a JOB table ( drawing 21 ). It can perform at step S112. 
Since JOB exists, it progresses to step S1 13. It can perform at step S113. JOB: Input The 
analysis of "printing <file A>" is acquired, step S1 14 — an input — "printing <file A>" It is 
understood that the object is printing <file A>. 

[0085] At step S1 15, it plans proposing printing to a color printer from the following condition 
and situation to a user. 

- The part of a color is contained in <file A> (part of the vehicle of drawing 22 ). 

- The usable color printer 2302 exists ( drawing 23 ). 

[0086] A user is asked to "Whether to print by the color printer" at step S1 19 ( drawing 24 ). 
Simultaneously, JOB of a response in case there is no response of a user is added to a JOB 
table ( drawing 25 ). And it returns to step S110. 

[0087] If there is no intercadence force for 10 minutes, since JOB which can be performed 
exists by step S112 at step S110, it progresses to step S113. JOB which can be performed at 
step S1 13 : A response in case there is no response of a user is acquired. 
[0088] At step S1 14, it is understood that the object of a response in case there is no response 
of a user is knowing whether your accepting a proposal. At step S1 15, it opts for what a user is 
asked using a telephone from the following condition and situation. 

- The user knows the telephone number of the location which is now (schedule data of drawing 
26 R> 6). 

- It must print immediately (with the schedule data of drawing 26 , file A is used for a business 



talk from 13:00). 

[0089] A user is asked to "Whether to print by the color printer" at step S1 19 ( drawing 27 ). 
Simultaneously, JOB of a response in case there is no response of a user is added to a JOB 
table ( drawing 28 ). It returns to step S1 10. 

[0090] step S1 10 — drawing 27 — like — a user — " — yes — well — " — ** — if it says, it 
will be judged that there is an input and it will progress to step S1 1 1. At step S1 11, it is the input 
analysis JOB. It adds to a JOB table ( drawing 21 ). Since JOB which can be performed exists at 
step S1 12, it progresses to step S1 13. the JOB:input which can be performed at step S1 13 — " 
— it is and the analysis of "is acquired well. It inputs at step S1 14. "is and it is understood well 
that the object of "is that having accepted the proposal is shown. 

[0091] It determines to send <file A> to a color printer 2302, and to print it at step S115. Step 
S1 18 <file A> is sent to a color printer 2302, and is printed. Simultaneously, JOB for the check 
of whether printing was completed normally is added to a JOB table ( drawing 29 ). It returns to 
step S110. 

[0092] If the printer status changes to input nothing at step S110 and changes to "those with 
printed document" "out of printing" like drawing 30 at step S1 12, since JOB which can be 
performed exists, it progresses to step S1 13. JOB which can be performed at step S113: 
Acquire the processing corresponding to the printer status. Since it is the semantics that the 
document with which the status "those with a printed document" was printed is left behind to 
the tray of a printer from the printer status table of drawing 31 at step S1 14, it is understood 
that the object is that a printed document passes into a user. 

[0093] Since a user may come to picking by step S115 immediately, at it, it determines to wait 
At step S1 16, JOB for the check of whether to have come the printed document to picking is 
added to a JOB table ( drawing 32 ). It returns to step S110. There is no intercadence force at 
step S1 10 for 10 minutes. Since JOB which can be performed exists at step S112 supposing a 
printed document is left behind, it progresses to step S1 13. JOB which can be performed at step 
S113: Acquire a response in case there is a printed document. Since it is the semantics that the 
document with which the status "those with a printed document" was printed is left behind to 
the tray of a printer from drawing 31 R> 1 at step S1 14, it is understood that the object is that a 
printed document passes into a user. It is determined that a user judges that he forgets and it 
will notify "A printed document is in a color printer" at step S115 since a document is left 
behind for 10 minutes. At step S119, it notifies "A printed document is in BJC600" ( drawing 
33 ). Simultaneously, JOB of a response in case there is no response of a user in a JOB table, 
and JOB of the response at the time of coming a printed document to picking are added 
( drawing 34 R> 4). It returns to step S1 10. 

[0094] There is no input at step S110. If the printer status changes from "those with a printed 
document" to "it is normal" like drawing 28, since JOB which can be performed exists at step 
S112, it progresses to step S113. JOB which can be performed at step S113: Acquire 
reexamination of JOB corresponding to those with a printed document. At step S114, it is 
understood that the object of reexamination of JOB corresponding to those with a printed 
document is deleting JOB which became unnecessary. It determines to delete JOB which is 
waiting for a user's response at step S115. JOB which is waiting for a user's response is deleted 
at step S1 19. Here, new JOB is not added. By the initial state, it returns to step S1 10. 
[0095] Drawing 36 and 37 are drawings showing the rule of a plan and action. 
[0096] A user is printing of drawing 20 . Window When it sets and a carbon button [printing] is 
pushed, with reference to plan & action of the table of drawing 36 , it is judged that a users 
object is that the present condition becomes "those with a printed document" Furthermore, 
since "those with a printed document" is also the target "printed document acquisition" 
prerequisite, it is judged that a final user's object is "printed document acquisition." 
[0097] A user is the question of drawing 24 or drawing 33 . When voice, mouse actuation, etc. 
perform actuation of approval manifestation or anti-mind manifestation to the inquiry by Window 
and the telephone of drawing 27 , it is judged that a user's objects are the approval manifestation 
to an inquiry and anti-mind manifestation. 

[0098] In drawing 37 , the ultimate object of a system is the object achievement of a user. As a 



prerequisite for that, the system must be stable. Moreover, a system understands ** user's 
object on it, and the ** object achievement is planned and it performs. 

[0099] As well as normalizing a system at the time of trouble, for the cutback of cost, or evasion 
of destabilization of a system, when there is no need of performing, a power source is turned off 
for stability of a system. 

[0100] Drawing 38 illustrates a part of drawing 37 intelligibly. 

[0101] In order to understand a users object, he understands an input, when there is an input 
Moreover, corresponding to "printed document acquisition" of the object of the user of drawing 
36 , what "a printed document is passed to a user for" exists as an object of a system. 
[0102] In order to pass a user a printed document, it is a premise that the printed document 
exists and it is going to attain the object by teaching a user the location which has a document 
on it Of course, although a user comes a document to picking or a document must be sent to a 
user by a certain approach in order for a user to acquire a document actually, in this system, in 
detail, the definition was not carried out but that a printed document is lost has judged that it is 
equivalent to the user having acquired. 

[0103] On the other hand, in order for there to be a printed document, while there is a printing 
agency document, printing conditions are clarified, it is a premise that the printing environment 
where it corresponds exists normally, the printing environment where it corresponds on it is 
chosen, and printing is performed. What is necessary is just to draw up a printing agency 
document, in order for there to be a printing agency document In order to clarify printing 
conditions, conditions should just ask a user an indefinite part. What is necessary is just to 
normalize a printing environment, when a printing environment is unusual in order for the printing 
environment to be normal. Moreover, RIPURANNINGU anew when there is no response from a 
fixed time amount user in order to acquire a user's volition. 

[0104] The property of each device is stored in the memory in the server which has managed 
the memory or each device inside each device. Drawing 39 is the example of the property of 
each device. The status of each device is having in the interior of each device, and each device's 
sending actively, or returning passively according to the demand of other servers etc., and is told 
to other equipments. 

[0105] In this system, a property is the thing of each device proper, and since it does not 
change, when the connection on the time of starting of a system or a network has modification, 
it is acquired. On the other hand, in the process which plans, the status is acquired if needed, or 
is acquired with a certain fixed time interval, and updating storage is carried out as information in 
internal memory. 

[0106] [Operation gestalt 12] As well as the operation gestalt 11, when printing <file A>, it is the 
example of processing in case a color printer is Busy. 

[0107] First input: If there is "printing <file A>", this will be added to a JOB table and it will be 
understood that the object is printing, here, the part of a color contains in a document as a 
condition and a situation — having — **** — an usable color printer — Busy it is — ** — it 
carries out Then, the plan to ask a user whether it waits or it prints in monochrome is stood 
until it stops being Busy. "Color printer is Busy, is it waiting measure? Or does it print by the 
monochrome printer? " — a user is questioned. A user When "it waits" is chosen, it stands by 
until it stops being Busy. 
[0108] [Operation gestalt 13] 

Input "<file A> was changed into <file A'X When there is ", it is understood that renewal of a 
JOB table is the object In a condition and a situation, <file A> prints on a JOB table. JOB It is. 
Then, it asks a user whether the object for printing is changed into <file A'X The plan to say is 
stood. And the question "whether <file A'> is printed instead of <file A> before correction" is 
emitted. 

[0109] [Operation gestalt 14] In the system (in this case, it connects with the network) to which, 
as for this operation gestalt, two or more equipments were connected When JOB is directed to 
each equipment, each equipment analyzes the object of JOB, and when it judges that it is better 
not to perform JOB activation with the equipment directed from its situation or the situation of 
a designating device, it is an operation gestalt for transmitting and performing JOB to other 



equipments. 

[0110] Drawing 41 is two examples showing the condition that two or more equipments are 
connected to the network, and (A) is the network of the environment where each equipment of a 
scanner 411 and printers 412 and 413 can judge each situation. (B) is the network of the 
environment where a scanner 41 1 cannot judge the situation of printers 412 and 413. 
[01 1 1] Drawing 42 is drawing showing the functional configuration for processing this operation 
gestalt The JOB receipt section 421 receives JOB from a user or other equipments. Received 
JOB is registered into the JOB table 422. The JOB analysis section 423 takes out and analyzes 
JOB registered into the JOB table 422. The other equipment situation seal step 424 judges an 
attribute, a current condition, etc. of other connected equipments. The self-equipment situation 
seal step 427 judges the own attribute, own current condition, etc. of equipment 
[0112] The optimal planning section 425 stands the optimal plan about activation of JOB. In the 
JOB activation decision section 426, when performing whether JOB is performed or not, it 
judges performing with other equipments whether it performs with self-equipment etc. When 
performing with self-equipment, it performs in the JOB activation section 428. When performing 
with other equipments, JOB is transmitted to other devices by the JOB transfer section 429 to 
other equipments. The advice section 211 of activation notifies a user of having transmitted JOB 
to an activation result or other equipments etc. 

[01 13] Drawing 43 is the flow chart showing the flow of the processing for realizing this 
operation gestalt of Maine. First, at step S430, it judges whether JOB was inputted by confirming 
whether there is new JOB generated by itself at the input JOB from the input JOB from a user, 
the device which can detect a system, the result of having analyzed these JOB(s), and the time 
of an idling. If inputted, JOB inputted into the JOB table will be added at step S431. If it 
investigates whether there is JOB on a JOB table and is shown in it at step S432, JOB will be 
taken out at step S433. At step S434, the given directions are analyzed and the object of JOB is 
analyzed from the information. At step S435, it judges whether there is JOB to other 
equipments, and if it is, other equipments will be controlled by step S436. If there is nothing, 
self-equipment will be controlled by step S437. 

[01 14] Drawing 44 is a flow chart showing the flow of the processing when controlling other 
equipments, when processing to other equipments in the Maine processing at step S436. 
[0115] The situation of the equipment specified in JOB is judged at step S440, and it judges 
whether a problem is to perform JOB with the specified equipment at step S441 based on this 
decision. If satisfactory, JOB will be transmitted to the specified equipment at step S442. The 
situation will be judged, if it investigates whether there is any equipment suitable for the JOB 
and is with equipments other than the specified equipment at step S443, when a problem is in 
activation with the specified equipment Consequently, if there is equipment which can perform 
the JOB except the specified equipment, a user will be notified of having transmitted JOB to the 
equipment and having transmitted JOB at step S446 at step S445. The optimal plan which is 
step S447 and does not spoil the object of JOB with any equipments other than the specified 
equipment on the other hand when current utilization cannot be carried out, even if there is no 
equipment suitable for the JOB or it is is stood, it is step S448 and the plan is proposed to a 
user. 

[01 1 6] Drawing 45 is a flow chart which expresses the flow of processing in the case of 
processing with its own equipment with step S437 in the Maine processing. 

[0117] At step S450, the situation of self-equipment is judged and it judges whether a problem is 
to perform JOB with self-equipment by step S451 based on this decision. If satisfactory, JOB 
will be performed at step S452. The situation will be judged, if it investigates whether there is 
any equipment suitable for the JOB and is with equipments other than serf-equipment at step 
S453, when a problem is in activation with self-equipment Consequently, if there is equipment 
which can perform the JOB except self-equipment, a user will be notified of having transmitted 
JOB to the equipment and having transmitted JOB at step S446 at step S445. The optimal plan 
which is step S447 and does not spoil the object of JOB with any equipments other than self- 
equipment on the other hand when current utilization cannot be carried out, even if there is no 
equipment suitable for the JOB or it is is stood, it is step S448 and the plan is proposed to a 



user. 

[01 18] In (A) of drawing 41 f it pointed so that the information read from the scanner 41 1 might 
be outputted to a printer 412 in the path of A, but in the other equipment situation seal step 424 
of a scanner 411, since drawing 46 discovered failure to the printer 412, it is drawing when 
outputting to a printer 413 through the path of B. 

[01 19] Although it points to drawing 47 so that the information read from the scanner 41 1 may 
be outputted to a printer 412 in the path of A in (B) of drawing 41 , and a scanner 41 1 tends to 
check the situation of a printer 41 2 Since it is in the distant location, in consideration of a 
network situation, information is transmitted unconditionally, and it is drawing since he is out of 
order, when a printer 412 transmits the received information (JOB) to a printer 413 in the path 
of B. 

[0120] Drawing 46 and the process in which processing of 47 is performed are explained based 
on the flow chart of drawing 43 -45 below. 

[0121] When an output JOB occurs from the scanner 41 1 of drawing 46 to a printer 412, 
processing of a scanner 41 1 is as follows. 

[0122] First, at step S430, information is scanned and JOB which transmits information to a 
printer 412 is received. At step S431, JOB is added to a JOB table. JOB is taken out at step 
S433. At step S434, he scans data and understands that this JOB is JOB which transmits to the 
directed printer. It judges that there is JOB which performs information which he scanned with 
other equipments of outputting by the printer 412 at step S435. By this decision, processing is 
passed to other device control processing of drawing 44 at step S436. 

[0123] The current condition of the directed printer 412 is acquired at step S440. Consequently, 
it judges that an output is impossible at a receipt and step S441 in the information which is 
breaking down from a printer 412. In this case, also when it is in the condition that outputs, such 
as a form piece and a toner piece, cannot be performed even if it is not [ be / it ] under failure 
for example, it thinks. At step S443, since it is impossible to perform JOB, from on a network, 
communication is taken and other same equipments which can perform JOB are searched with 
the printer 412 which is directed equipment. Since the printer 413 which can perform JOB was 
discovered at step S444, it opts for activation of JOB in a printer 413. 

[0124] At step S445, the scanned information is transmitted to a printer 413. It notifies having 
changed JOB at step S446, to the partner who directed, since the thing except having been 
directed was performed. Since processing of directed JOB was ended above, it waits until the 
next JOB is inputted. 

[0125] Next, processing when an output JOB occurs from the scanner 41 1 of drawing 47 to a 
printer 412 is explained. 

[0126] With a scanner 411, at step S430, information is scanned and JOB which transmits 
information to a printer 412 is received. At step S431, JOB is added to a JOB table, and JOB is 
taken out at step S433. At step S434, he scans data and understands that this JOB is JOB 
which transmits to the directed printer. It judges that there is JOB which performs information 
which he scanned to other equipments of outputting by the printer 412, at step S435. By this 
decision, processing is passed to other device control processing of drawing 44 at step S436. 
[0127] Although it is going to communicate with the directed printer 412 and is going to get to 
know the situation at step S440, since it is checked that it is in the location which the printer 
412 left, it judges transmitting information regardless of the condition of a printer 412. At step 
S441, since the printer 412 is separated, it is judged as a satisfactory thing. At step S442, the 
information scanned to the printer 412 which is directed equipment is transmitted, and JOB is 
passed. Since processing of directed JOB was ended above, it waits until the next JOB is 
inputted. 

[0128] On the other hand, by the printer 412, JOB which outputs the received information at 
step S430 is received. At step S431, JOB is added to a JOB table. JOB is taken out at step 
S433. He understands that it is JOB to which he outputs the received information at step S434. 
At step S435, it is judged that there is no JOB to other equipments. Processing is passed to 
self-device control processing of drawing 45 at step S437. 

[0129] Its current condition is seen at step S450. At step S451, he judges that it is [ current ] 



under failure and activation of JOB cannot be performed. In this case, also when it is in the 
condition that outputs, such as a form piece and a toner piece, cannot be performed even if it is 
not [ be / it ] under failure for example, it thinks. Communication is taken from on a network and 
the same equipments of other as themselves which can perform JOB are searched with step 
S453. 

[0130] Since the printer 413 which can perform JOB was discovered at step S454, it opts for 
activation of JOB in a printer 413. At step S455, the information transmitted to the printer 412 
is broadcast again to a printer 413. It notifies having changed JOB at step S456, to the partner 
who directed, since processing except having been directed was performed. Here, although the 
partner who directed was notified, since it is the location distant from the partner whom the 
output destination change directed, it may be made to notify to a recipient Since processing of 
JOB directed above was ended, it waits until the next JOB is inputted. A printer 413 does not 
have a problem, and since JOB which outputs the received information can be performed, JOB 
is performed. 

[0131] Although each equipment transmitted JOB automatically with the above operation gestalt, 
when a problem is in each equipment, it is also possible to attach and set up ranking so that a 
user may transmit JOB. For example, in this operation gestalt, although the user has inputted 
printing by the printer which specified the scanned document as JOB, when the printer specified 
at this time is unusable, the 2nd and 3rd printer which executes printing by proxy may be 
simultaneously set up into JOB. Thereby, as a device which fitted JOB in step s443 or step 
s453, the 2nd and 3rd set-up printer is chosen and the situation is judged. Moreover, when he is 
unusable, the 2nd and 3rd printer which executes printing by proxy may be set to the printer side 
which receives JOB conversely. At this time, though the 2nd and 3rd printer is set up by the 
JOB itself as mentioned above, the printer which received JOB can transmit JOB according to 
the assignment set as itself. 

[0132] Moreover, when failure and actuation are impossible, even if it is except, when JOB of the 
spec, unsuitable for performing JOB, for example, a monochrome printer, is printing of the 
information on a color, or also when there is much waiting for JOB and it cannot process 
immediately, it can become the decision conditions which do not perform JOB. 
[0133] [Operation gestalt 15] In performing JOB which outputs the emergency intelligence which 
the printer received to a user, this operation gestalt expresses the processing in the case of also 
considering the target users schedule information as a decision ingredient which judges the 
problem of activation of JOB in the processing which judges the situation of the self-equipment 
of step S450 of drawin g 45 . 

[0134] Here, the user who should tell emergency intelligence is out and processing of the 
environment shown in drawing 48 in which the printer 413 connected to the going-out place in 
the network exists is explained. 

[0135] In this case, in the procedure of drawing 43 , the object of JOB understands that it is 
connecting the received information to a user immediately at step S434. At step S435, since it is 
not JOB to other equipments at this event, processing is passed to step S437. Processing is 
passed to self-device control processing of drawing 45 at step S437. 

[0136] At step S450, when judging the situation of self-equipment, a user's schedule directed as 
a transmission place is checked to equipment 414, and it is judged that he is out At step S451, 
since a user is going out [ be / it ], for urgent communication, it is judged that a problem is in 
activation with self-equipment. It checks whether at step S453, the printer in which an output of 
information is possible is in a going-out place. Since it checked that there was a printer 412 in 
which an output is possible at step S454, it determines to output by the printer. At step S455, 
information is transmitted to a printer 412. At step S456, the user of the destination is notified 
of having transmitted JOB delivery origin. 

[0137] Moreover, when it is judged that there are other equipments which a user uses, for 
example, PC, FAX, a telephone, etc. at step S443 by the case where there is no equipment in 
which the output same as the destination of JOB is possible, it is good though performed with 
the equipment in step S444. However, since information cannot be transmitted as it is, at step 
S445, the print-out to a printer is changed, and will make it an electronic mail document and a 



FAX document and it will transmit, or will change and output to speech information. 

[0138] It is not necessary to notify having transmitted JOB anew using another media depending 

on the media used for an output, and can also tell simultaneously by the same media at step 

S446 at this time. For example, when transmitting a print-out using a telephone, the rear stirrup 

which told the print-out is considered as it is more smart to tell the data of having transmitted 

before. 

[0139] In addition, it is step S447 and determines to use those equipments as optimal plan which 
does not spoil the object of JOB, and it is step S448 and you may make it propose the plan, 
without judging PC mentioned above, FAX, a telephone, etc. to be the devices suitable for JOB 
which should be performed by the printer at step S443. 

[0140] [Operation gestalt 16] The procedure of this operation gestalt is shown in drawing 49 . 
Drawing 49 adds step S498-500 as processing when there is no JOB in the flow chart of drawing 
43 . At step S498, by step S499, the current situation of other equipments of operation is 
investigated, and it judges whether others and equipment are covered with, without performing 
JOB which can be performed by itself, and when having collected, at step S500, the JOB is 
taken out, and it adds to the JOB table of self-equipment, and deletes from the JOB table of 
partner equipment Thus, with this operation gestalt, JOB is found out and processed itself. 
[0141] Drawing 50 is in the situation of performing this processing, and since JOB does not exist 
in a printer 412 but the printer 413 has ten waiting JOB(s), it is drawing showing the concept 
which a printer 415 takes out JOB of a printer 413 and processes with self-equipment. 
[0142] The flow of processing of a printer 415 is as follows. At step S492, since there is no JOB, 
it passes processing to step S498. At step S498, the current situation of the printer 412 which 
are other equipments, and a printer 413 is investigated. It judges that JOB which can be 
performed by itself is in a printer 413 at step S499. At step S500, the JOB is added to ejection 
and its own JOB table from a printer 413. Furthermore, taken-out JOB is deleted from a printer 
413. There is no input of JOB at step S490. Since JOB which added the point by itself exists at 
step S492, processing is passed to step S493 in order to perform JOB. 

[0143] Henceforth, actuation for performing with one's equipment explained with the operation 
gestalten 14 and 15 is performed, and processing is ended. 

[0144] [Operation gestalt 17] Drawing 51 is drawing having shown the flow of Print JOB in the 
system which used the equipment of this operation gestalt, and other information flows. In 
addition, the thick arrow head in drawing expresses the flow of Print JOB, and the arrow head of 
a dotted line expresses other information flows. 

[0145] However, the parameters referred to at the time of printing of the document used as the 
object for printing and printing number of sheets, printing quality, printing size, etc. are included 
in the print JOB stated with this operation gestalt Moreover, there are the statuses, such as 
normal and those without a form, and a schedule of the print JOB which the print JOB 
scheduling section has in the information on other during printing which each printer has. 
[0146] In drawing 51 , with a client machine 510, once creating Print JOB in the print JOB 
creation section 512 and memorizing in the print JOB storage section 513, it is transmitted to 
the server machine 51 1 which manages a printer by the print JOB transmitting section 514 from 
the client machine 510 which created Print JOB. 

[0147] In a server machine 51 1, when the parameters of reception and Print JOB have not set 
up the sent print JOB by the print JOB receive section 516, the print JOB automatic setting 
section 517 is passed, and delivery and when already being set up, the print JOB automatic 
modification section 518 is passed. 

[0148] A non-set up printing parameter is set up in the print JOB automatic setting section 517, 
taking into consideration the urgency acquired from Print JOB, profitability, quality, etc. On the 
other hand, in the print JOB automatic modification section 518, changing the parameter already 
set up in the same processing is also realized. Thus, the print JOB set up or changed is 
registered into the schedule of the print JOB which the print JOB scheduling section 520 has, 
and reading appearance is carried out from there to the sequential print JOB transmitting 
section 519, or it is printed over the immediate printing JOB transmitting section 519. 
[0149] Here, the status of usable printers acquired through the printer situation-recognition 



section 515, such as under printing, normal, and those without a form, includes the print JOB 
automatic setting section 517 and the print JOB automatic modification section 518, and it is 
used for them in setting out or modification of Print JOB. Moreover, the printing schedule of the 
print JOB which the print JOB scheduling section 520 has is gone across and used similarly. 
[0150] Moreover, as expressed to drawing 51 , it is also assumed that Print JOB flows in a 
different path. For example, when the machine which has managed the printer is the same as the 
machine which created Print JOB, it cannot pass along the print JOB transmitting section 514. 
[0151] Drawing 52 is a flow chart showing the flow of processing of the print JOB automatic 
setting section 517. Automatic setting of the parameter is carried out so that it can print as 
quickly as possible and as economically as possible in the range which is satisfied with the print 
JOB automatic setting section 517 of the specified quality. 

[0152] At drawing 52 , the factor which determines printing time amount and the amount of the 
toner used is first initialized as preparation of a simulation at step S520. Then, a quality decision 
variable is initialized by the quality peak price (for example, 5) at step S521, and printing time 
amount is simulated at step S522. It judges whether the printing time amount which it simulated 
fills an assignment value with step S523. When filled, it is step S524 and the amount of the toner 
used is simulated. It judges whether the amount of the toner used which it simulated fills an 
assignment value with step S525. When filled, it is step S526 and JOB is changed into the value 
of a current quality decision variable. 

[0153] Step S When not filling the specified value with 523 or 525, one quality decision variable 
is reduced at step S527. Whether the specified quality is filled with step S528 judges, and if filled, 
processing will be returned to step S522. If not filled, it becomes an automatic setting impossible 
error and ends. 

[01 54] Drawing 53 is drawing showing the printing time amount and the amount of the toner used 
of per [ used ] character by the difference in the assignment quality of a printer A521 and a 
printer B522. The eternal value of each printer proper is sufficient as these values, and the value 
which measures the business time amount and the amount of the toner used of printing used 
performed in the past, and took the average from this measured value and which changes 
dynamically is sufficient as them. 

[0155] Drawing 54 is drawing showing the parameter which the user specified as the content of 
the print JOB printed with this operation gestalt. tn the system using this operation gestalt it is 
called Print JOB in accordance with the content of the print JOB expressed with drawing 54 , 
and the active parameter. With this operation gestalt, in order to simulate printing time amount 
and the amount of the toner used, the amount of printings of Print JOB is explained as 500 
characters by the number conversion of alphabetic characters. Moreover, the user should 
specify only urgency as less than 1 minute, and neither profitability nor quality should be 
specified with the default 

[0156] In the example of drawin g 54 f starting of the print JOB automatic setting section 517 
initializes the factor which determines printing time amount and the amount of the toner used in 
preparation of a simulation of step S520 first For example, as it was defined as the table of 
drawing 53 , each printing time amount per character in the case of the minimum quality (= 1) of 
a printer A521 and a printer B522 is the an average of 100m step S and the 200m step S, and 
the amount of the toner used per character is an average of 100mg and 200mg. 
[0157] Then, a quality decision variable is initialized by the quality peak price (for example, 5) at 
step S521, and printing time amount is simulated at step S522. For example, if one does not have 
the print JOB by which can print and the schedule is carried out by print JOB scheduling, 
printing can be started immediately and the latency time of a printer A521 and a printer B522 is 
unnecessary. Therefore, when 500 characters are contained in the print JOB for printing, by 
Printer A, it takes 250 seconds, and if it takes 500 seconds, it will simulate by Printer B. 
[0158] Then, since less than [ urgency 1 minute ] which was specified with the assignment 
parameter of drawing 54 cannot be filled with step S523, one quality decision variable is reduced 
at step S527. Here, since quality is not specified with the assignment parameter of drawing 54 , 
processing is again returned to the simulation of the printing time amount of step S522. Since 
printing time amount becomes 50 seconds by the printer A521 only after quality is set to 1 of 



the minimum quality as a result of repeating these processings, and urgency is fulfilled, quality is 

set as the value (= 1) of a quality decision variable, and is terminated normally. 

[0159] Here, since the parameter which the user set up cannot be filled supposing it has set 

quality or more to two, it becomes an automatic setting impossible error and ends. 

[0160] [Operation gestalt 18] Drawing 55 is a flow chart showing the flow of processing of the 

print JOB automatic modification section 518. In the range which is satisfied with the print JOB 

automatic modification section 518 of the urgency and profitability which were specified, an 

automatic change of the parameter is made so that it can print for high quality as much as 

possible. When it cannot be satisfied with on top of that of all assignment assignment of the 

highest priority is satisfied, and other assignment is changed so that closely [ assignment ] as 

much as possible. 

[0161] Drawing 56 is drawing showing the parameter which the user specified as the content of 
the print JOB printed with this operation gestalt. In the system using this operation gestalt, it is 
called the content of the print JOB expressed with drawing 56 with Print JOB in accordance 
with the active parameter. With this operation gestalt, in order to simulate printing time amount 
and the amount of the toner used, the amount of printings of Print JOB is explained as 500 
characters by the number conversion of alphabetic characters. Moreover, although the user set 
up all the parameters, it is specified also in it that quality is top priority. 
[0162] In drawing 55 , starting of the print JOB automatic modification section 518 first 
initializes the factor which determines printing time amount and the amount of the toner used in 
preparation of a simulation at step S550. For example, as it was defined as the table of drawing 
53 , each printing time amount per character in the case of the minimum quality (= 1) of Printer 
A and Printer B is the an average of 100m step S and the 200m step S t and the amount of the 
toner used per character is an average of 100mg and 200mg. 

[0163] Then, a quality decision variable is initialized by the quality peak price (for example, 5) at 
step S551, and printing time amount is simulated at step S552. For example, if one does not have 
the print JOB by which can print and the schedule is carried out in the print JOB scheduling 
section 520, printing can be started immediately and the latency time of a printer A521 and a 
printer B522 is unnecessary. Therefore, when 500 characters are contained in the print JOB for 
printing, by the printer A521, it takes 250 seconds, and if it takes 500 seconds, it will simulate by 
the printer B522. 

[01 64] Then, since less than [ urgency 1 minute ] which was specified with the assignment 
parameter of drawing 56 cannot be filled with step S553, one quality decision variable is reduced 
at step S556. Since assignment of the quality of the assignment parameter of draw in g 56 is filled 
with step S557, processing is again returned to the simulation of the printing time amount of 
step S552. As a result of repeating these processings, even if it becomes the quality (= 3) 
specified by a user, printing time amount is 150 seconds by the printer A521, and cannot fulfill 
urgency. Then, if a quality decision variable is reduced by one, since it becomes impossible to fill 
the quality specified by a user with step S557, it progresses to step S558, and quality will have it 
confirmed whether to be an assignment parameter of the highest priority, and will change and 
terminate Print JOB normally with step S556 in the specified quality by step S560 the case of 
the highest priority. 

[01 65] Here, since printing time amount will become 50 seconds by Printer A only after quality is 
set to 1 of the minimum quality and urgency will be fulfilled supposing urgency is top priority, 
quality is set as the value (= 1) of a quality decision variable, and is terminated normally. 
[0166] [Operation gestalt 19] Drawing 57 is drawing having shown the flow of Print JOB in the 
system which used the equipment of this operation gestalt, and other information flows, [n 
addition, the thick arrow head in drawing expresses the flow of Print JOB, and the arrow head of 
a dotted line expresses other information flows. 

[0167] However, the parameters referred to at the time of printing of the document used as the 
object for printing and printing number of sheets, printing quality, printing size, etc. are included 
in the print JOB stated with this operation gestalt Moreover, there are the statuses, such as 
normal and those without a form, and a schedule of the print JOB which print JOB scheduling 
has in the information on other during printing which each printer has. 



[0168] In drawing 57 , with a client machine 510, once creating Print JOB in the print JOB 
creation section 512 and memorizing in the print JOB storage section 513, it is transmitted to 
the server machine 51 1 which manages a printer by the print JOB transmitting section 514 from 
the client machine 510 which created Print JOB. 

[0169] In a server machine 511, the sent print JOB is passed to reception and the print JOB 
interpretation section 571 by the print JOB receive section 516. In the print JOB interpretation 
section 571, the directions from a user included in the received print JOB are interpreted, and it 
changes into information, such as a parameter which can process a system. When the 
parameters of Print JOB have not been set up, the print JOB automatic setting section 517 is 
passed, and delivery and when already being set up, the print JOB automatic modification 
section 518 is passed. 

[0170] A non-set up printing parameter is set up in the print JOB automatic setting section 517, 
taking into consideration the urgency acquired from Print JOB, profitability, quality, etc. On the 
other hand, in the print JOB automatic modification section 518, changing the parameter already 
set up in the same processing is also realized. Thus, the print JOB set up or changed is 
registered into the schedule of the print JOB which the print JOB scheduling section 520 has, 
and reading appearance is carried out from there to the sequential print JOB transmitting 
section 519, or it is printed over the immediate printing JOB transmitting section. 
[0171] Here, the status of usable printers, such as normal and those without a form, includes the 
print JOB automatic setting section and the print JOB automatic modification section 518 during 
printing acquired through the printer situation-recognition section 515, and it is used for them in 
setting out or modification of Print JOB. Moreover, the printing schedule of the print JOB which 
the print JOB scheduling section 520 has similarly is also gone across and used. 
[0172] Moreover, as expressed to drawing 57 , it is also assumed that Print JOB flows in a 
different path. For example, when the machine which has managed the printer is the same as the 
machine which created Print JOB, it cannot pass along the print JOB transmitting section 514. 
[0173] With this operation gestalt, as shown in drawi ng 58 , setting out of the parameter of Print 
JOB is vaguely set up using natural language. Drawing 130 is drawing having shown the 
semantics which the character string in a parameter setup expresses, and a demand item 
required in order to complete the semantics corresponding to the input string by natural 
language. In the print JOB interpretation section 571, it interprets as follows with reference to 
the semantics corresponding to the input string by the natural language which showed directions 
by the natural language passed as a print JOB active parameter in drawing 130 , and a demand 
item required in order to complete semantics. 

[0174] Action used as a users object which a character string "printing" to this character string 
under inputted natural language means is [printing]. Furthermore, the item demanded from there 
and a [object] are the contents of the print JOB inputted simultaneously itself, and [quality] and 
[number of sheets] will be expected if it should be specified in the part as which it is not 
interpreted under inputted natural language, then, a character string — " — the object for 
customers — an interpretation of one sheet and five-sheet" for members understands being 
specified that [number-of-sheets] 1 sheet is printed in high-definition [quality], and it prints 
[number-of-sheets] 5 sheet in free [quality]. 

[0175] Processing of the print JOB automatic setting section 517 and the print JOB automatic 
modification section 518 after this is the same as that of the operation gestalten 17 and 18. 
[0176] [Operation gestalt 20] With this operation gestalt, as shown in drawing 59 , setting out of 
the parameter of Print JOB is performed based on the distribution place and number of sheets 
which were indicated by the document itself which is the content of the print JOB. In the print 
JOB interpretation section 571, the content of the print JOB is interpreted and it operates as 
follows. Action is printing. "The object for customers" interprets it as high-definition, and makes 
number of sheets one sheet. An "ABC project" is "an object for members", interprets it as 
grace being free, and number of sheets makes it five sheets (it has in advance the information 
that a user is the member of an ABC project.). 

[0177] The processing after the print JOB automatic setting section 517 and the print JOB 
automatic modification section 518 after this is the same as that of the operation gestalten 17 



and 18. 

[0178] [Operation gestalt 21] Drawing 60 is drawing having shown the flow of Print JOB in the 
system which used the equipment of this operation gestalt, and other information flows. In 
addition, the thick arrow head in drawing expresses the flow of Print JOB, and the arrow head of 
a dotted line expresses other information flows. 

[01 79] However, the parameters referred to at the time of printing of the document used as the 
object for printing and printing number of sheets, printing quality, printing size, etc. are included 
in the print JOB stated with this operation gestalt Moreover, there are the statuses, such as 
normal and those without a form, and a schedule of the print JOB which the print JOB 
scheduling section 520 has in the information on other during printing which each printer has. 
[0180] In drawing 60 , with a client machine 510, once creating Print JOB in the print JOB 
creation section 512 and memorizing in the print JOB storage section 513, it is transmitted to 
the server machine 51 1 which manages a printer by the print JOB transmitting section 514 from 
the client machine 510 which created Print JOB. 

[0181] In a server machine 51 1, the sent print JOB is passed to reception and the print JOB 
interpretation section 571 by the print JOB receive section 516. In the print JOB interpretation 
section 571, the directions from a user included in the received print JOB are interpreted, and it 
changes into information, such as a parameter which can process a system. When the 
parameters of Print JOB have not been set up, the print JOB automatic setting section 517 is 
passed, and delivery and when already being set up, the print JOB automatic modification 
section 518 is passed. Moreover, in the print JOB simulation section 601, printing by setting out 
specified on Print JOB is simulated, and printing time amount and the amount of the toner used 
are calculated. 

[0182] A non-set up printing parameter is set up in the print JOB automatic setting section 517, 
taking into consideration the urgency acquired from Print JOB, profitability, quality, etc. On the 
other hand, in the print JOB automatic modification section 518, changing the parameter already 
set up in the same processing is also realized. Thus, the print JOB set up or changed is 
registered into the schedule of the print JOB which the print JOB scheduling section 520 has, 
and reading appearance is carried out from there to the sequential print JOB transmitting 
section 519, or it is printed over the immediate printing JOB transmitting section 519. 
[01 83] Here, the status of usable printers, such as normal and those without a form, includes the 
print JOB automatic setting section 517 and the print JOB automatic modification section 518 
during printing acquired through the printer situation-recognition section 515, and it is used for 
them in setting out or modification of Print JOB. Moreover, the printing schedule of the print 
JOB which the print JOB scheduling section 520 has similarly is also gone across and used. 
[0184] Moreover, as expressed to drawing 60 , it is also assumed that Print JOB flows in a 
different path. For example, when the machine which has managed the printer is the same as the 
machine which created Print JOB, it may not pass along the print JOB transmitting section 514. 
[0185] Drawing 61 is the flow chart of processing by the print JOB simulation section 601. In the 
print JOB simulation section 601, the factor which determines printing time amount and the 
amount of the toner used is first initialized as preparation of a simulation at step S61 1. At step 
S612, the printing time amount in setting out specified on Print JOB is simulated, the amount of 
the toner used in setting out specified on Print JOB by step S613 is simulated, and printing time 
amount and the amount of the toner used are calculated. 

[0186] The concrete approach is the same as that of what was explained with the operation 
gestalten 17 and 18. 

[0187] [Operation gestalt 22] With this operation gestalt, two or more output trays are prepared 
in a printer, and the tray outputted according to a user is chosen. 

[0188] Drawing 62 is the flow chart of the procedure of the printer system of this operation 
gestalt A printer system starts processing of drawing 62 , after processing the response at the 
time of receiving two or more prints JOB simultaneously etc., if Print JOB is received. 
[0189] The external view of the printer of the printer system of this operation gestalt is shown in 
drawing 63 . As shown in this drawing, these printers 631 and 632 have two or more output trays, 
have the screen which indicates whose document the document on that tray is in each output 



tray by the printer 631, and express whose document is shown in a common screen at which 
output tray as a printer 632. Moreover, if the user is beforehand set up for every output tray, it 
becomes an output tray only for users, and if it does not set up especially, the user of each 
output tray will change if needed. 

[0190] Functions, such as telling the failure of a printed document which tells arrival of a 
document and which tells termination of printing taking by this system (the sensor sticking), are 
realized. The flow of the above processing is explained. 

[0191] In drawing 62 , receivers address information is acquired from the information included in 
Print JOB at step S621. Receiver s address information is acquired by interpreting the 
assignment filled in as the operation gestalt 29 explaining into the content of the print JOB, or is 
acquired from the information set up apart from the content of the print JOB from the beginning 
like E-mail. When using it, usually carrying out like [ instead of FAX or E-mail ] like [ although the 
receiver's address is not specified ] the system using this operation gestalt in using a printer as 
an output device of the usual personal computer like the example of an activity of the 
conventional technique at this time, usually the receiver s address is specified as reverse. At 
step S622, it is confirmed whether the receiver's address is specified. At step S623, the man of 
the receiver's address is notified of the document having arrived. At step S624, sending agency 
information is acquired from the information included in Print JOB. Sending agency information is 
acquired by interpreting the assignment filled in as the operation gestalt 29 explaining into the 
content of the print JOB, or is acquired from the information set up apart from the content of 
the print JOB from the beginning like E-mail. When using it, usually carrying out like [ instead of 
FAX ] like [ although a sending agency is in the management range of this system ] the system 
using this operation gestalt in using a printer as an output device of the usual personal computer 
like before at this time, as for sending-conversely origin, it is common that there is nothing in 
the management range. At step S625, it is confirmed whether a sending agency is in the 
management range. At step S626, when the receiver's address is specified, an output tray is 
chosen corresponding to the receiver's address. When the receiver's address is not specified but 
only the sending agency is specified, an output tray is chosen corresponding to a sending 
agency. As shown in (a) of drawing 63 R> 3, the information on receivers address or sending 
origin is expressed on a corresponding output tray as step S627. Or as shown in (b) of draw ing 
63 , the information on receiver's address or sending origin and the location of an output tray are 
displayed on a common-display screen, [f the user is beforehand set up for every output tray at 
this time, it becomes an output tray only for users, and if it does not set up especially, the user 
of each output tray will change if needed. 

[0192] Printing is performed at step S628. It is confirmed whether, at step S629, a sending 
agency is in the management range by completing printing. At step S630, it notifies that printing 
was completed to a sending agency. It is confirmed whether at step S631, a fixed time amount 
document remains and a sending agency is in the management range. At step S632, it notifies 
that the printed document remains in the sending agency for a long time. 

[0193] [Operation gestalt 23] The information about time amount is dealt with with this operation 
gestalt Drawing 65 is drawing showing the functional configuration of the system of this 
operation gestalt The processing section 650 was equipped with the understanding section 652, 
the planning section 653, the activation section 654, the response section 655, and the 
knowledge base 656, and has connected with a database 651. 

[01 94] Drawing 64 is the flow of overall processing of this operation gestalt, and flow-chart-izes 
procedure in the functional configuration of drawin g 65 . 

[0195] At step S640, it investigates whether there is any input from the outside, and if it is, he 
will analyze the text inputted by the understanding section 652 at step S641 with reference to 
the knowledge base 656 per a word or sentence, and will analyze and understand the object of 
the content of an input by step S643 further. If it judges whether information required for the 
target understanding is insufficient and there is lack at step S644, it will ask to a user at step 
S645, the reply from a user will be learned to the knowledge base 656, and it will return to step 
S643. If there is no lack, it will progress to step S646. Moreover, at step S640, if there is no 
input, the work which should be performed will be found out by step S642, and it progresses to 



step S646. 

[0196] At step S646, the planning section 653 performs the planning for attaining the object At 
step S647 t if it judges whether information required for a planning is insufficient and there is lack, 
it will ask to a user at step S648, the reply from a user will be learned to the knowledge base 
656, and it will return to step S646. If there is no lack, a plan will be performed by the activation 
section 654 at step S649. At this time, if needed, a database 651 is accessed or the activation 
section 654 communicates with other applications. And the content is determined when judging 
whether a response should be performed at step S650 by the response section 655. 
Furthermore, at step S651, the response corresponding to the determined content is created 
and a user is answered. 

[0197] if , when it have recognize to the information inputted from the outside f for example , a 
keyboard entry , voice input , E-mail and FAX , news information , etc. , the understanding 
section 652 analyze the content , analyze a time concept from the language in a text , and it 
understand the content of the text which have involvement in time amount . 
[0198] Drawing 67 is drawing showing the example which extracts schedule information from an 
electronic mail. Above-mentioned processing analyzes the content of the document received by 
E-mail, as specifically shown in drawing 67 . The time concept of "February 22", "13:30", and 
"15:00" is found out and analyzed, and the patent system explanation meeting is planned in B 
conference room from [ which has involvement in this concept / text "/ on February 22 ] 13:30 
to 15:00. " — by understanding, it becomes possible to match the action relevant to time 
amount with a schedule. 

[0199] Moreover, the time concept and current time which were analyzed are compared, if it is 
the time of day of the future, the action will be registered into a schedule, if it is description 
about the past time of day, without registering with a schedule, it will cancel or an individual 
database etc. will be registered as information on classes other than a schedule as record of the 
past occurrence. 

[0200] Moreover, the information as which the understanding section 652 was inputted from the 
outside, for example, keyboard entry, The contents, such as voice input, E-mail and FAX, and 
news information, are analyzed. When a plan without the language (a word, concept etc.) which a 
system does not know yet in the language in a text, or having performed etc. is discovered When 
there is no urgency in the language and plan, it learns by finding the information in connection 
with the language and plan one by one, and stores in the knowledge base 656 as information. 
[0201] It is memorizing something that is called XYZ existing, when the language which is not 
known "XYZ" comes out and then specifically analyzing the text XYZ's being "dramatically 
delicious", "XYZ's being hard", etc., and XYZ is hard and delicious food. It learns. 
[0202] If a user understands it as the plan at the time of an absence from the situation at that 
time, for example when the first plan is directed also about a plan, it will learn as an example of 
how to stand the plan at the time of a user absence. 

[0203] Furthermore, the system which is reporting the action and the plan which the system 
performed to the user each time when the information in connection with a user is acquired from 
news etc. is received. It is not necessary to carry out a report of this information from a degree, 
a user — a report — the carrier beam time — " — By taking out directions with the natural 
language " etc. to a system, a system can also be learned so that the information may not be 
reported. 

[0204] As mentioned above, in this system, the content of the information inputted from the 
outside is analyzed in the understanding section 652, the object is analyzed, and in order to 
attain the object in the planning section 653, the plan of the action which a system must perform 
is stood. And processing is performed in the activation section 654. Moreover, the response 
section 655 informs a user of the performed processing. 

[0205] For example, when it is understood in an individual database from the addressers 
information at a carrier beam case that E-mail which is shown in drawing 67 is mail from a non- 
registered partner, the information about the man is extracted from e-mail, and it registers with 
the individual database of a database 651. Furthermore, also when the information about a non- 
registered person is in an individual database in addition to it, you may make it register with an 



individual database. 

[0206] Moreover, by understanding that e-mail is advice of an explanation meeting, it accesses 
at the schedule of the user of a database 651, and time amount with the existing schedule data 
is matched. When there were no problems, such as a collision with the existing schedule data, in 
new schedule data and a problem is discovered as drawing 69 R> 9 shows this data, although 
additional registration of the schedule is carried out, the report to the answer and user to a 
transmitting agency is created. 

[0207] Thus, by understanding the content from the received information, this system makes the 
response which a system should perform according to a situation, and is performed. 
[0208] In addition, although processing in which an answer was created and returned to the 
partner who has sent E-mail, without a system checking to a user was performed in the above- 
mentioned explanation, this is the action performed from the result of the text "connect the 
more inconvenient one urgently" being in a document, and having analyzed this since it judged 
that the urgency of a response was high. Here, when the holding schedule was quite previous 
time, or it is a meeting of arbitration participation etc. and it is judged that the urgency of a 
response is low, it opts for the action performed according to an urgency, such as checking to a 
user in advance of a response. 

[0209] Moreover, it is possible like the directions from the user by natural language to access 
and answer a schedule, an individual database, etc. to the natural language input from a user. 
[0210] for example, — " — whom — that the telephone number of that accesses an individual 
database by asking a question what No. ?" with natural language **** — " — the board on the 
16th is where — it is possible by receiving a question with natural language as ?" to access a 
schedule and to reply to a user. 

[021 1] Drawing 66 is drawing showing the class [ exterior / which perform overall processing of 
this operation gestalt / the system and the exterior ] of I/O. 

[0212] As an input it can input from a keyboard or the voice inputted from the natural language 
information received as an electronic mail or the document inputted as an image from a scanner, 
an image, a microphone, etc., the image inputted from a camera can be treated. The input of 
natural language can be acquired by performing character recognition processing to the 
document read with the scanner, and performing speech recognition processing to voice. 
[0213] In an input, those (Idle) without an input look for the work which the system itself should 
perform, when anything does not have an input from the outside, as step S642 of drawing 64 R> 
4 showed, and they are taken as an input. For example, when it is an idle state without the given 
work, news are accessed, and it goes to take oneself the information which has involvement to a 
user, and considers as input. 

[0214] Moreover, as an output, they are the registration to databases, such as a schedule, filing 
in a file storage unit, or deletion of data. Furthermore, there are advice to a user, answerback to 
a transmitting agency, etc. That an important thing can make judgment that it cannot process in 
the range of an understanding of a system, and carries out the response of the purport which is 
not made with an output etc. is the point which can perform other actions, when processing is 
impossible. 

[0215] Moreover, as a partner of I/O, there are other processing sections or another 
applications inside the equipment of a user or the exterior or a system etc. 
[0216] Moreover, while close analyzes the document to which it came, carries out data 
extraction of the information about people, and the information about time amount and stores 
them in a personal data base or schedule data, information required to guess action expected is 
also extracted and it is used by planning. 

[0217] Close came by the example of drawing 67 . E-mail As description concerning people as a 

To : tosbima^abc. canon, co. jp, 

rohra@abc. canon, co. jp, 

kazuyo§abc. canon, co. jp 

|A c . , , From: ichiro§abc. canon, co. jp 

result of analyzing a document, 



He is Suzuki of a system intellectual property propulsion division. 

Suzuki (ichiro@abc.canon.cojp) 044-549-6312 Canon (extension 620-5151) Co., Ltd. — The 
intellectual-property headquarters system intellectual property propulsion division exists, among 
these the person whose mail address is "kazuyo@abc.canon.co.jp" is registered in an individual 
database, supposing other persons have not registered, the information on PERSON 1, 2, and 3 
will be extracted from there like drawing 67 , and they will be registered into a database 651. 
[0218] On the other hand, as description of the information about time amount, since "the 
patent system explanation meeting is planned from [ on February 22 ] 13:30 to 15:00 in B 
conference room" exists, the information on EVENT1 is extracted from there^ 
[0219] Furthermore, as description used for guessing action expected, since "connect the more 
inconvenient one urgently" exists, it is used by the processing explained henceforth [ drawing 
70]. 

[0220] Drawing 68 is the flow chart with which the part required for origin was extracted [ the 
flow of the processing for performing processing of drawing 67 and drawing 69 ] for the flow 
chart of drawing 64 , and the executive operation step S649 was expressed more concretely. 
[0221] According to drawing 67 and the flow of 69, it explains concretely below. 
[0222] At step S680, if there is an input of E-mail, the inputted E-mail document will be analyzed 
for every word or sentence by step S681. At step S683, he understands "there is peoples 
information" and there "there being an event called an explanation meeting" from a signature 
and a header. Furthermore, he understands "an answer is required at the time of 
inconvenience." 

[0223] People's information is extracted and the plan registered into a database and the plan to 
register an explanation meeting event into a schedule are built at step S684. An activation plan 
exists at step S685. At step S686, since it is satisfactory, processing is passed to step S688. At 
step S688, peoples information is extracted, and it registers with a database, and returns to step 
S685. 

[0224] In the case of drawing 67 , the activation plan to register an explanation meeting event 
into a schedule exists at step S685. At step S686, since this event can be registered into a 
schedule without a problem, it passes processing to step S688. A schedule is registered at step 
S688. If it returns to step S685, since there is also no advice sentence at step S689 by there 
being no activation plan, processing will be ended. 

[0225] In the case of drawing 69 , the activation plan to register an explanation meeting event 
into a schedule exists at step S685. The collision of a schedule is discovered at step S686. 
Since there is a problem in activation of a plan, since it is inconvenient, a plan is reorganized at 
step S687 so that an answer may be reported to delivery and a user. The plan to write an 
answer and to transmit at step S685 exists. At step S686, since it is satisfactory to activation of 
a plan, it is step S688, and convenience draws up the document of a bad purport and transmits a 
reply document to the partner of a transmitting agency. At step S685, the document preparation 
plan for advice of a user exists. At step S686, it is satisfactory to activation, and is step S688, 
and the document which notifies a user of having sent the answer which asks you for 
reconsideration by the content of the E-mail and schedule collision is drawn up. At step S685, 
there is nothing, an activation plan is step S689, since it has an advice sentence, a user is 
suitably notified of it, and it ends processing. 

[0226] Schedule information by which data extraction was carried out in the example of drawing 
69 EVENT1 Schedule planned from before As a result of comparing EVENT2, it turns out that 
the schedule has lapped. Furthermore, according to the information extracted in the example of 
drawing 69 , when inconvenient, it also turns out that it must connect So, in the system using 
this operation gestalt, using the information of letter creation, since the schedule has lapped, the 
letter which tells the purport that a board cannot be attended is created and an answer is 
transmitted automatically. 

[0227] Furthermore, the user of the system using this operation gestalt is notified of the system 
using this operation gestalt having sent the answer automatically. 

[0228] [Operation gestalt 24] Drawing 70 is drawing showing an example when a user questions 
the system of this operation gestalt with voice. 



[0229] If a user asks a question "********? which does tomorrow's board where" with voice, a 
system can answer the location of a board with reference to a user's schedule information. 
Furthermore, explanation is performed, creating an explanation story and mixing graphical image 
and voice, after planning whether it becomes intelligible, when the way to the location where a 
board is held for a user is not found, and a question was asked "Where [ of bottom Maruko ] it 
is", and explaining to the user how further with reference to the database to it 
[0230] Drawing 71 is the flow chart with which the flow of processing of drawing 70 was 
expressed based on the basic flow chart of drawing 64 . Here, the input from the outside serves 
as a question. 

[0231] The processing to the 1st question is explained. At step S710, if voice input (********? 
which does tomorrow's board where) from the outside is performed, it will be step S71 1 and an 
input statement will be analyzed. At step S712, he is a question about tomorrow's board and 
understands that a user s object is getting to know the location. At step S713, in order to reply 
to a question, the following plannings are performed. ** Take out tomorrow's schedule. ** 
Acquire the location registered into the schedule. ** Perform document preparation for notifying 
the acquired location. 

[0232] Although it is step S714, and processing is passed to step S716 since there is no lack of 
information in this case, since it does not know which board it is when two or more boards exist 
in a schedule, asking a user at step S715 and reorganizing a plan again will be performed. At step 

5716, the plan stood at step S713 is performed, and the document of an answer to a user is 
drawn up. It determines to reply, since the document of which a user should be notified exists at 
step S717. It is also simultaneously determined that he understands that the input was voice at 
this time, and an answer will also perform it with voice by it At step S718, a user is notified of 
the document changed into voice data. 

[0233] Here, although processing is once ended, the question from a user is inputted 
continuously. The processing to the 2nd question is explained. 

[0234] If voice input (where [ of bottom Maruko ] is it ?) from the outside is performed at step 
S710, an input statement will be analyzed at step S711. He understands that it is the question 
which understands that it is the continuation question of the 1st question at step S712, and asks 
the concrete location of the answered name. 

[0235] At step S713, in order to reply to a question, the following plannings are performed. ** 
The plan to acquire an image required from a plan, ** image database, and the database of a 
location for what it pours to a plan that explanation is difficult in written form, and ** image is 
poured in order, and is explained, the plan to draw up the document which doubled with ** image. 

[0236] There is no lack of information at step S714. At step S716, sequential execution of the 
plan stood at step S713 is carried out, and the document of an answer to the user who doubled 
with the image is drawn up. Since the document of which a user should be notified exists at step 

5717, it determines to reply. It is also simultaneously determined to explain with voice by it, 
understanding that the input was voice at this time, and displaying an image on a monitor. A user 
is notified at step S718. The flow of the processing of a single string of drawing 70 by the above 
is ended. 

[0237] [Operation gestalt 25] When a schedule laps, the example of drawin g 72 proposes to a 
user, after planning how [ of the priority of two schedules ] should be evaluated and carried out 
[0238] That is, in the case of this example, when one schedule is more important than another 
side, it is proposed that the schedule of the direction which is not comparatively important is 
canceled. 

[0239] When it has the information that a user can see off a deputy about the schedule which 
had cancellation proposed, to it, a system can perform further action united with it by replying to 
a system such. Moreover, it can also learn about the plan to see off a deputy, at this time. 
[0240] D rawing 72 is step S686 explained with the flow chart of drawing 68 , and combines other 
examples of how to stand the plan in step S646 of drawing 64 at the time of discovering the 
collision of a schedule. 

[0241] Although drawing 68 explained as processing which transmits the answer of 



inconvenience to a partner unconditionally, here explains the processing using two or more reply 
NINGU as an art of RIPURANNINGU of step S646. 

[0242] Drawing 73 is the flow chart of the processing for evaluating a priority from the content 
of the document and proposing to a user as reply NtNGU at the time of a schedule collision. This 
processing is explained below. 

[0243] The priority of the schedule described above is synthetically determined from the 
attendant to the information which the user set up beforehand for every schedule, and the event 
contained in a schedule, the object of a schedule, the result analyzed from the received content 
of a document Here, the priority determined from an attendant may be set up to a person from 
whom a user becomes an attendant beforehand. 

[0244] Moreover, a user may set up beforehand the priority determined from the object of a 
schedule, and it may be made to be determined by taking into consideration similarity with the 
object and field in which the user who learned from the past actuation is interested. That is, 
priority is given to the direction of the schedule of a computer-related event over an estate- 
related event when the user is engaged in computer-related work. Of course, priority may be 
given to the direction of the schedule of an estate-related event, if the user is considering the 
purchase of a house and that is memorized as information about a user. 

[0245] On the other hand, as a priority determined from the analysis result of the content of a 
document, when the schedule of the document of the description "be sure to be present", and 
the document of the description "be present if it can do" collides, suppose that former one is 
judged that a priority is high etc., for example. 

[0246] [n drawin g 73 , the existing schedule information is acquired at step S730. Step S731 
estimates the priority of new schedule information. The priority of both information is measured 
at step S732. The plan to draw up the advice document (for example, for two schedules which 
collide to be shown and for it to be asked whether I may cancel about the one where a priority is 
lower) for asking a user from a comparison result at step S733 is stood. The created advice 
sentence is told to a user at step S734. At step S735, the answer from the user to an inquiry of 
a plan is obtained. Here, in order to perform a users answer and to plan a users answer again as 
an input, the same processing as answer RIPURANNINGU of drawing 68 is performed ( drawing 
74). 

[0247] Drawing 74 is the flow chart of processing of above-mentioned RIPURANNINGU. 
[0248] The answer eventually obtained by drawing 73 at step S740 is given to an input An 
input-statement document is analyzed at step S741. At step S742, he understands that they are 
modification of a schedule, and the first directions plan. 

[0249] The following plans are stood at step S743. (a) Change a schedule, (b) Draw up the 
document for notifying an acting man. (c) Learn a new plan, (d) Draw up the document of which a 
user is notified, (e) Notify that it remembers and there is a schedule. 

[0250] At step S744, the plan stood at step S743 is performed, (a) Change a schedule, (b) Draw 
up and notify the document for notifying an acting man. (c) Learn the plan to order an agent (d) 
Add to a creation document that draw up the document for notifying a user, it (e) Remembers, 
and there is a schedule. 

[0251] At step S745, the advice sentence to a user is told to a user. Above, explanation of the 
processing for performing processing of drawing 72 is ended. 

[0252] [Operation gestalt 26] Drawing 75 is drawing showing a whole image also including I/O of 
the system of this operation gestalt. Drawing 76 is a flow chart showing the flow of processing of 
the whole system of drawing 75 . 

[0253] The information inputted from various input devices, such as E-mail, voice, keyboard 
entry, WWW, a telephone, FAX, a scanner, and a camera All are analyzed in the input 
Management section 751 (step S760). In the Core section 752 After understanding the content 
and planning suitable processing (step S761), by the output Management section 753 After 
determining output media and making preparations of the content of an output, or an output path 
(step S762), it is outputted from various output equipment, such as E-mail, voice, WWW, a 
telephone, FAX, a printer, and a copy machine. 

[0254] Drawing 77 -79 are the flow chart with which step S760 (processing of the input 



Management section 751) which is each step of the whole drawing 76 flow chart, step S761 
(processing of the Core section 752), and step S762 (processing of the output Management 
section 753) were expressed concretely. 

[0255] In drawing 77 , the input Management section 751 is step S770, and waits for a new input 
The information inputted at step S771 is acquired. At step S772, analysis processing of the 
acquired input is performed, when it has recognized, if . At this time, the input Management 
section 751 can receive information from various media, is an approach according to each media, 
and performs recognition and analysis. 

[0256] In drawing 78 , the Core section 752 performs receipt processing for the input analyzed 
by drawing 77 . 

[0257] At step S780, he analyzes and understands the object of input from an analysis result At 
step S781, it investigates how the object of input is related to itselves (a system, user). That 
planning which should perform what from its relation at step S782 according to the object is 
performed. At step S783, the plan made from step S782 is performed. 

[0258] In drawing 79 , if the output Management section 753 determines whether it is necessary 
to carry out a response from the result performed by drawing 78 and has the need, it will create 
and output a response. 

[0259] At step S790, analysis of the result performed by drawing 78 is performed. At step S791, 
it judges whether the response to the performed result occurs. If there is nothing, processing will 
be ended as it is. When a response occurs, it is determined whether what we do with the 
response to the response from the outside at step S792. The media which perform a response 
are determined at step S793. The response doubled with the determined media is created at 
step S794. The response created at step S795 is published according to media. At step S796, a 
response is outputted physically actually. The above is processing showing the whole drawing 75 
image. 

[0260] For example, when E-mail which tells a user about holding of a board arrives, input is first 
analyzed in the procedure of draw ing 77 by the input Management section 751. From this result, 
in the procedure of drawing 78 , it is planned how a user and a system should correspond and 
the Core section 752 processes it. the result is passed to the output Management section 753, 
processing is performed by the procedure of drawing 79 , and a response should be carried out - 
- ** — when planned, a response is performed actually. 

[0261] Here, it is step s782, and since it will be planned if it is required to notify a user positively 
depending on the content of the board and the situation of the schedule of the user before it 
which were told by E-mail, a response is needed. Therefore, it is judged as those with a response 
at step s791. The content which carries out a response is determined at step s792. For example, 
when the schedule has collided, selection of one of schedules is urged or, in the board which is 
not understood whether it should participate or not, the content itself which carries out a 
response, such as asking the decision, is determined here. Then, in step s793, the media which 
can tell most effectively the content of the response for which it opted above are determined. 
For example, if a user is in a going-out place, the media of which the user of going-out places, 
such as a telephone and FAX, can also be notified are chosen, and if it is the midst which is 
using the personal computer etc. for reverse, media, such as a personal computer which can 
display various data effectively, will be chosen. Then, in steps s794 and s795, according to the 
content and media which were determined above, a document and an image are created, and a 
response is created and published by the approach of being further changed into natural 
language voice depending on media. 

[0262] Drawin g 80 is a flow chart for explaining how data are extracted from the information still 
more detailed and inputted [ the overall flow of drawing 75 ]. 

[0263] By the system using this operation gestalt, when a document is inputted, with reference 
to notations for classification distinction, such as a layout of a document, and a bar code, the 
type of a document is first guessed at step S801. Consequently, if a document can guess a 
letter, a report, a patent official report, etc. and it cannot progress and guess to step S803, it 
progresses to step S810, perfect OCR is performed, and a document type is decided. 
[0264] At step S803, by OCR, in order that the guessed document type may check whether it is 



the right, OCR of the block characteristic of checking a document type is carried out, and it is 
interpreted (refer to drawing 82 ). Consequently, at step S804, the destination of a letter, the 
patent number of a patent official report, etc. are known, and a document type is checked. If in 
agreement [ with the document type which this checked document type guessed ] and it is not 
[ it progresses to step S806 and ] in agreement with it, it progresses to step S810. For example, 
if it is the electronic forms with which the character string which expresses the class of 
document to a part for the upper part of a form is printed, document type decision is easy by 
carrying out OCR of the upper part of the form. 

[0265] At step S806, a specific block is read by OCR using the knowledge base of the document 
type by which the check was carried out [ above-mentioned ], and it interprets, and checks 
[ whether the information related to the information acquired as a result at step S807 existed in 
the past, and ], when it exists, it progresses to step S808, and when it does not exist, it 
progresses to step S810. Consequently, the destination, a patent number, etc. are known and it 
is understood whether it is the answer of the letter sent in the past 

[0266] At step S808, the object is judged from the content of the text which becomes important 
for origin about the situation by which an understanding was carried out [ above-mentioned ] 
etc., and it opts for the processing performed at step S809. 

[0267] At step S81 1, an analytical range is extended and analyzed from the object understood 
above in the range in which OCR of others is not carried out, and processing is performed 
actually henceforth [ step S812 ]. Consequently, processing of filing etc. will be performed if 
required. 

[0268] Since OCR can be performed by the above-mentioned processing, guessing the content, 
it becomes possible obtaining an efficient exact OCR result rather than performing perfect OCR 
suddenly like before, and processing to which it is carried out based on an OCR result can also 
be performed correctly. 

[0269] Drawing 81 is drawing showing the letter set as the object of data extraction processing / 
example of fax. 

[0270] In this example, the type of a document is guessed from the layout of a document at step 
S801. Consequently, it becomes a DocTypel = letter / fax. 

[0271] On the other hand, a specific block is read and interpreted by OCR at step S803. (Refer 
to drawing 82 ) Consequently, From, To, Dear Sir, etc. are obtained and it is checked with a 
DocType2= letter / fax at step S804. 

[0272] Specific block reading by OCR explained at step S803 of drawing 80 is explained 
concretely. Drawing 82 R> 2 is drawing explaining this processing. 
[0273] In the system using this operation gestalt, scanning is performed as follows. 
** Read into a high speed by the PURISU can with low resolution. 

** Compare the read informational form with the form information currently stored in DB823, 
and when in agreement, read only the information inputted in addition to form, or the information 
on the field (for example, part within the limit on the card of drawing 82 ) specified for every form 
with high resolution. 

** Analyze only the field read above as an object of OCR, and continue processing. 
[0274] Furthermore, since the possibility of the form with the same document which it is going to 
read with the fixed time interval since it assumes that two or more cards of the same form exist 
in this example is high, it processes as a thing of the same form first, and re-analysis is 
performed as that from which form differs only after conflict occurs. 

[0275] By this, an analytical range is limited, an analysis domain is pinpointed by moreover 
specifying form with the large improvement in processing speed, and the large improvement in 
analysis precision is attained. 

[0276] Decision of the object from a content etc. explained at step S808 of drawing 80 is 
explained concretely. 

[0277] In the system using this operation gestalt, decision of processing is performed by the 
procedure of drawing 83 with reference to the data of the date. The following processing is 
performed when an informer is a user. 
** When the date is today, judge that it transmits by FAX. 



** When the date is before yesterday, ask a user whether the before same document was sent 
and whether the same content has been seen, and judge whether it is the mistake of filing, 
retransmission of message, and a user. 

** When the date is after tomorrow, hold till the day specified as the date, or ask whether to be 
a user's mistake. 

[0278] When the document of drawing 81 was made into the example, Datel is made into the 
date of a document and Date2 is specifically made into todays date, ** Datel = November 25, 
1996 & Date2 = November 25, 1996 - Document **** ** Datel = November 25, 1996 & Date2 = 
July 2, 1997 - File ** Datel = November 25, 1995 & Date2 = November 26, 1996 Contents date 
= December 18, 1996, 22 days - Mistake [0279] Drawing 83 is an example of the flow chart of 
processing which analyzes the object from the inputted document If a document is inputted, it is 
judged that it is the document which the document which the transmitting person had it judged 
at step s830 whether you were a user, and was inputted in other than a user received, it will be 
step s831, the objects, such as filing and data extraction, will be probed corresponding to it and 
it will end. 

[0280] On the other hand, when a transmitting person is a user, in order to analyze further what 
kind of document the inputted document is, it progresses after step s832. The date of a 
document and today's date are compared by step s833, and when it is confirmed whether the 
document was before transmitted at step s835 when the date was near and it has not 
transmitted, it is determined that the object is "transmission of a document" Moreover, in the 
case of the document transmitted before, it is step s843 and the objects, such as filing and 
retransmission of message, are probed corresponding to it 

[0281] It is confirmed whether on the other hand, when the date of a document was quite a 
former thing, it progressed and transmitted to step s836, and when it is the transmitted 
document, similarly it progresses to step s843. When having not transmitted, it progresses to 
step s837 and it is confirmed whether the other date is indicated from the information in a 
document. When the date is found, similarly it progresses to step s843. It is judged that the date 
may have mistaken, although transmission of a document can be considered as an object when 
there is no date. 

[0282] Moreover, when it is confirmed whether there is any other publication of the date from 
the information in a document at step s840 when the date of a document is quite [ date / 
current ] a previous thing and the date is found at step s841, it is determined that the object is 
"transmission of a document." When there is no date, it progresses to step s839. 
[0283] [Operation gestalt 27] Drawin g 84 is drawing showing one of the examples of the 
structure of a system which used this operation gestalt In this example, a system operates like 
the present FAX. 

[0284] However, according to the system of this operation gestalt, without a user specifying a 
transmission place, from the information on the bar code given to the read document, or a cover 
sheet the transmission place of a document is judged and it can transmit to a suitable 
transmission place. 

[0285] By this, information will be sent suitable for a printer, and FAX, E-mail and WWW. 
[0286] [Operation gestalt 28] Drawing 8 5 is drawing showing one of the examples of the 
structure of a system which used this operation gestalt In this example, a system realizes the 
function of a desk sorter to process all the documents on a desk. 

[0287] That is, according to the content of the read document a classification, filing, scheduling, 
other data extraction, and automatic activation of processing are performed. 
[0288] [Operation gestalt 29] Drawing 86 explains to a detail further the system explained by 
drawing 85 . Based on drawing 86 R> 6, procedure is concretely explained according to the flow 
chart of drawing 87 . 

[0289] Draw ing 87 is a flow chart showing the procedure of this operation gestalt Drawing_88 
and drawin g 89 express the information used during this processing, and drawing 88 expresses 
the information of the common knowledge base. Drawing 89 expresses the information of the 
knowledge base of the field specified as the cover page. The character string contained in the 
document inputted with reference to the information defined by dr^wjng.88 and d^wing_89 with 



this operation gestalt is compared with the character string defined by the column of the 
character string in drawing, and it analyzes by acquiring the concept of the congruous items, 
Role which specifies the semantics further, Condition which specifies the information which 
follows, or the directed processing Action. 

[0290] In drawing 87 , at step S870, a cover page is scanned and OCR processing is performed. 
At step S871, information, such as a name of a transmitting person and an addressee, the 
telephone number, and a FAX number, is extracted with reference to the knowledge base of 
drawing 88 . The extracted information is registered into a database at step S872. For example, 
the cover page of a document which received in the example of drawing 86 "To : The character 
string Macrohard Corp." is contained. Then, the item "To" which is in agreement as compared 
with the item defined as the column of the character string of drawing 88 is discovered, and 
since the Role is a receiving firm name or a name, "Macrohard Corp." is extracted as an 
addressee's information. 

[0291] At step S873, actions and JOB(s), such as the advice approach, a means and a filing 
activity, and a location, are taken out from the knowledge base of the field specified as the cover 
page of drawing 89 . For example, the cover page of a document which received in the example 
of drawing 86 "File : A character string called MH/Contract" is contained. Then, the item "File" 
which is in agreement as compared with the item defined as the column of the character string 
of drawing 89 is discovered, as directed action, filing is taken out and "MH/Contract" is 
extracted out of a document as information on a filing location. 

[0292] Here, it is on Datel = November 25, 1996. Supposing it is on & Date2 = November 25, 
1996, as explained per drawing 83 , it will be judged as object-document ****. 
[0293] At step S874, it checks whether action for the object of this processing exists. At step 
S875, action transmitted since it is the object to transmit a document to a partner is performed. 
It judges whether at step S876, there is any need for filing from the information on a cover page. 
At step S877, since there is need in the example of drawin g 86 , it files in "MH/Contract" which 
is the directed location. 

[0294] At step S878, it judges whether it is necessary to notify a transmitting person from the 
information on a cover page like step S876. Since notifying a transmitting person with voice is 
directed, a transmitting person is notified of having transmitted the document to the partner at 
step S879 with voice. At step S880, it judges whether other actions occur. In step S881, since 
there is keyword assignment, an index is created by keyword called ABC. 
[0295] [Operation gestalt 30] Drawing 90 is drawing showing the example which refers to the 
hysteresis performed in the past based on directions by the natural language by which voice 
input was carried out, and performs processing. Based on drawing 90 , processing is explained 
according to the flow chart of drawing 91 . 

[0296] Drawing 91 is a flow chart which shows the flow of processing of this operation gestalt 
From a user, with voice, if the directions "Fax Contract again to John.Notify him by Phone." are 
received, this system will analyze the object of directions by the received natural language, and 
he will understand "broadcasting a document called Contract again to John by FAX, and telling 
arrival by telephone." Then, in order to specify Document Contract and the transmission place 
John concretely and to perform processing, the flow of drawing 91 is performed. 
[0297] At step s910, since transmission is performed before, retransmission of message acquires 
hysteresis information from a database. Consequently, Documents Contract and John are 
specified from hysteresis information. At step S91 1, it is from a personal data base. John The 
destination is acquired. Although a transmission place cannot be specified in the database if it is 
original since two persons' John called John Smith and John Bush exists, it is having referred to 
hysteresis information at step s910, and before, it becomes clear that John which sent 
Document Contract is John Smith, and a transmission place is specified. At step S912, the 
"Contract" document is acquired from a filing database. At step S913, it is a transmission place. 
John A document is transmitted. At step S914, since there are advice directions "Notify him by 
Phone", it is judged that there is the need for advice. At step S91 5, like drawing 89 , it directs to 
FAX901 of a transmission place from the rule of the knowledge base so that advice may be given 
to an addressee by telephone. At step S916, since action the outside of it is not directed, it ends 



processing. 

[0298] Furthermore, FAX901 which received the document notifies having received the 
document from Mr.Doors to John by telephone according to the above-mentioned advice 
directions. In addition, when FAX901 cannot notify by telephone, it may be made to carry out by 
being a transmitting agency. 

[0299] [the operation gestalt 31] — the content of the input-statement document to the user 
by whom drawing 95 was analyzed should perform something — ** — after judging and asking a 
user actually, it is the flow chart of the example which carried out automatic activation of the 
required processing. Drawing 92 is drawing showing the example of an input-statement 
document. Drawing 93 is drawing showing the content of the conversation of a system and a 
user. Drawing 94 is the output-statement document which the system drew up, judging from the 
conversation of drawing 93 . 

[0300] Based on the flow chart of drawing 95 , processing until it draws up the output-statement 
document of drawing 94 from the input-statement document of drawin g 92 R> 2 is explained. 
[0301] At step S950, he analyzes the input-statement document of drawing 92 , and understands 
the following objects, (a) John Smith him — arrive in Yokohama at 3:00 on November 28. (b) 
John Smith him — poor at Japanese, (c) I want you to pick up at a station. 
[0302] At step S951, it judges whether a user should perform something from the understood 
content Here, since it judges that it must go to invite to a station, it moves to step S952. At 
step S952, it judges whether a it (system) can perform in a deputy. Here, since a system cannot 
go to greet by oneself, it moves to step S953. At step S953, it judges whether it is necessary to 
ask a user or not, and progresses to step S954. From the destination of the document inputted 
in this example Aruna Rohra Since it is judged that it is a request of addressing to him, it moves 
to step S954. 

[0303] At step S954, it asks by doing the activity for asking a user (Mr. Aruna Rohra). Although it 
must go by this example to make Mr. John a user from the result understood at step s951, it is 
asked to the user how it should be coped with. It judges what is performed next from the asked 
result at step S955, and judges whether it is necessary to take action or not. In this example, 
since the user is directing so that it may order going to invite to Mr. Tanaka, he takes action 
according to those directions. Therefore, since the need of ordering whether I being able to ask 
of Mr. Tanaka instead here came out, it is judged that it is necessary to take action. At step 
S956, document preparation for asking a deputy of Mr. Tanaka and communication are 
performed. Here, the document for electronic mails is drawn up and it transmits. In this example, 
since it says that the information that Mr. John will arrive on the 28th, directions of wanting you 
to pick up instead of a user, and the document of an original copy that became the origin of this 
request are attached, automatic creation of the document is carried out 
[0304] The flow of the processing for above carrying out the matter (here, that is it going for 
welcoming to a station) from which a user has to take action actually from an input-statement 
document was explained. 

[0305] [Operation gestalt 32] Drawing 96 is drawing showing the operation gestalt which 
operates a system with remote control. 

[0306] According to the system of this operation gestalt each other can be specified as each 
other by communicating directly [ a device and remote control ] or indirectly. Thereby, a function 
called high UI of a degree of freedom corresponding [ actuation according the capacity of ** 
automatic device specification and ** device to UI (user interface) of the acquisition from a 
device and ** device proper and ** voice and ** basic operation ] to UI of community and ** 
user proper and ** situation to all devices is realized. 

[0307] That is, the device for actuation is automatically recognized only by turning ** remote 
control to the device for actuation. ** Acquire the information for every device from the device 
itself through IrDA or wireless LAN. ** While realizing UI of a device proper from the information 
for every acquired device and enabling actuation with ** voice ** It is realizing common basic 
operation by making fundamental actuation operational with the same remote control, and 
referring to ** user's identification information. It acquires required information from a database 
or an address book for every user, and it not only realizes UI of a user proper, but realizes 



optimal UI according to ** situation. 

[0308] At drawing 96 , by turning remote control 960 to FAX963, model identification information 
is obtained from FAX963, and UI corresponding to this model is activated and is continued to 
displayed "Fax to". With a touch pen By inputting the character string "Fax to John" and 
directing to FAX963 The FAX number of John is read from the address book 965 in a personal 
computer 964, and the document with which it was specified on the file in the document set to 
FAX963 or a personal computer 964 is transmitted to the number. About this detail, it mentions 
later. 

[0309] [Operation gestalt 33] Drawing 97 is drawing showing the example of a status monitor. 
[0310] According to the system of this operation gestalt information other than the machine 
with which the user is performing the direct control can be referred to. 
[031 1] Thereby, it is ** remote. & The function in which it can respond to ail the devices in 
which ** voice actuation with the function of the common I/O for seeing handicap management 
** automatic device specification, and ** status and ** cellular phone and ** infrared I/O are 
possible is realized. That is, even if it is the location distant from the device for **, it becomes 
acquirable [ required information ]. ** Recognize the device for actuation automatically only by 
turning remote control to the device for actuation. ** realizing common basic operation by 
making fundamental actuation operational with the same remote control, and giving the function 
of a cellular phone to ** remote control — operability — improving — ** voice actuation — 
possible — carrying out — ** — a response in all the devices in which infrared I/O is possible 
is attained by using a general protocol. 

[0312] In drawin g 97 , the status monitor 970 is turned to a printer 961, a copy machine 962, or 
FAX963, by inputting and directing the character string "Status" with a touch pen, status 
information can be read from the device to which the status monitor 970 was turned to the 
status monitor 970, and the user of the status monitor 970 can check the status of each device. 
Moreover, even when a personal computer 964 is in the location which cannot receive the 
instruction from the status monitor 970 for example, status information can also be read from a 
personal computer 964 to the status monitor 970 through a network and a printer 961 by 
specifying a personal computer 964 to the printer 961 grade which can communicate through 
this personal computer 964 and network, and requiring the status. 

[0313] [Operation gestalt 34] Drawing 98 is drawing in which remote control 960 recognizing an 
object model and showing the example which reads corresponding UI from the interior of remote 
control 960, and displays it It is the screen of a default where the message "turn to a machine 
to operate" was displayed on remote control in the condition of having not turned to the object 
model, like the center of drawing. 

[0314] Here, the flow of communication between remote control and an object model is 
explained. In addition, ** and ** are not indispensable at the following explanation. For example, 
the same effectiveness is realizable if the object model has always emitted the signal towards 
remote control at fixed spacing by **. Or you may make it an object model or other equipments 
detect that remote control 960 is turned to an object model from the physical relationship of 
remote control 960 and an object model. Moreover, the equipment configuration of an object 
model is seen, and remote control 960 reads the bar code given to the object model, and you 
may make it identify an object model or identify an object model by **. That is, only the 
indispensable part is illustrated in drawing 98 . 
[0315] ** A user turns remote control 960 to an object model. 

** In order to determine the timing which sends an object model recognition signal demand signal 
to an object model from remote control 960, a user touches the touch panel of remote control 
960 etc. Or it is set up so that an object model recognition signal demand signal may always be 
beforehand sent at fixed spacing. 

** Send an object model recognition signal demand signal to an object model from remote 
control 960. 

** If it is set up according to the demand of the object model recognition signal demand signal 
from remote control 960 so that an object model recognition signal may always be beforehand 
sent at fixed spacing, an object model recognition signal will be sent according to the setting out 



** The remote control 960 which received the object model recognition signal determines UI in 
accordance with the object model which a signal shows, and displays corresponding UI currently 
stored in the remote control 960 interior. Here, although the recognition signal was made into 
every model, it is carrying out to every device, and UI from which this model also differs for 
every device can also be used. 

[0316] Remote control recognizes an object model and drawing 99 is a flow chart in the example 
which reads corresponding UI from the interior of remote control 960, and displays it which 
shows the example of processing by the side of remote control. The flow of processing by the 
side of remote control is explained. 

[0317] At step S991, it stands by until there is directions actuation of a user. The object model 
recognition signal demand signal for having an object model recognition signal sent from an 
object model at step S992 is sent by the infrared approach. At step S993, it stands by until an 
object model recognition signal is sent from an object model. UI corresponding to the received 
object model recognition signal is acquired from the memory of the interior which can refer to 
remote control 960 etc., and is expressed as step S994. 

[0318] Remote control 960 recognizes an object model and drawing 100 is a flow chart in the 
example which reads corresponding UI from the interior of remote control 960, and displays it 
which shows the example of processing by the side of an object model. The flow of processing 
by the side of an object model is explained. 

[0319] At step S1001, it stands by until there is a demand signal from remote control 960. At 
step S1002, an object model recognition signal is sent by approaches, such as infrared ray 
communication. 

[0320] [Operation gestalt 35] Drawing 101 is drawing in which remote control shows reception 
and the example to display for UI from an object model. The screen of a default is displayed on 
the remote control 960 in the condition of having not turned to the object model, like the center 
of drawing 101 . 

[0321] Here, the flow of communication between remote control and an object model is 
explained. 

[0322] In addition, ** to ** is not indispensable at the following explanation. For example, the 
same effectiveness is realizable if the object model has always emitted the signal towards 
remote control at fixed spacing by **. Or you may make it an object model or other equipments 
detect that remote control 960 is turned to an object model from the physical relationship of 
remote control 960 and an object model. Moreover, the equipment configuration of an object 
model is seen, and remote control 960 reads the bar code given to the object model, and you 
may make it identify an object model or identify an object model by **. That is, drawing 101 is 
explaining only the indispensable part. 

[0323] ** A user turns remote control 960 to an object model. 

** In order to determine the timing which sends UI demand signal to an object model from 
remote control 960, a user touches the touch panel of remote control 960 etc. Or it is set up so 
that UI demand signal may always be beforehand sent at fixed spacing. 
** Send UI demand signal to an object model from remote control 960. 

** Send UI according to a demand of UI demand signal from remote control 960. Or if it is set up 
so that UI may always be beforehand sent at fixed spacing, UI will be sent according to the 
setting out. 

** The remote control 960 which received UI displays UI. 

[0324] Drawin g 1 02 is a flow chart with which remote control 960 shows the example of the 
processing [ in / for UI / reception and the example to display ] by the side of remote control 
from an object model. The flow of processing by the side of remote control is explained. 
[0325] At step S1021, it stands by until there is directions actuation of a user. UI demand signal 
for having UI sent from an object model at step S1022 is sent by approaches, such as infrared 
ray communication. At step S1023, it stands by until UI is sent from an object model. Received 
UI is expressed as step S1 024. 

[0326] Draw in g 103 is a flow chart with which remote control shows the example of the 



processing [ in / for UI / reception and the example to display ] by the side of an object model 
from an object model. The flow of processing by the side of an object model is explained. 
[0327] At step S1031, it stands by until there is a demand signal from remote control 960. At 
step S1032, Ul is sent by approaches, such as infrared ray communication. 
[0328] [Operation gestalt 36] When Ul of each device has drawing 104 in the wireless LAN 
server 1041 and UI is required towards the copy machine 962 which is an object model about 
remote control 960, it is the request from a copy machine 962 and is drawing showing the 
example as which UI is transmitted and displayed from the wireless LAN server 1041 to remote 
control 960. 

[0329] The screen of a default is displayed on the remote control 960 in the condition of having 
not turned to the object model, like the center of drawing 104 . 

[0330] Here, the flow of communication between remote control and an object model is 
explained. 

** A user turns remote control 960 to an object model (here, it considers as a copy machine 
962). 

** In order to determine the timing which sends UI demand signal to an object model from 
remote control 960, a user touches the touch panel of remote control 960 etc. Or it is set up so 
that UI demand signal may always be beforehand sent at fixed spacing. 

** Send UI demand signal to an object model with the remote control identification information 
(it considers as remote control A) for identifying remote control 960 self. 
** The object model which received remote control identification information and Ul demand 
signal from remote control requests transmission of delivery and UI from the server 1041 which 
has managed the object model for the object model identification information (copy machine) 
which discriminates the object model itself from remote control identification information 
(remote control A). 

** A server 1041 sends UI of the model shown by object model identification information through 
wireless LAN etc. to the remote control 960 shown by remote control identification information. 
** The remote control 960 which received Ul of sent addressing to itself displays UL 
[0331] Remote control does not receive Ul from an object model directly, but drawing 105 is the 
flow chart of processing by the side of remote control [ in / through wireless LAN etc. / for UI / 
reception and the example to display ]. 

[0332] The flow of processing by the side of remote control is explained. At step S1051, it 
stands by until there is directions actuation of a user. The remote control identification 
information for discriminating the remote control itself from UI demand signal for having UI sent 
to an object model at step S1052 is sent by approaches, such as infrared ray communication. At 
step S1053, it stands by until UI from where is sent Received Ul is expressed as step S1054. 
[0333] Drawing 106 is a flow chart with which remote control does not receive Ul from an object 
model directly, but shows the example of the processing [ in / for UI / reception and the 
example to display ] by the side of an object model through wireless LAN etc. The flow of 
processing by the side of an object model is explained. 

[0334] At step S1061, it stands by until there is a demand signal from remote control 960. At 
step S1062, the remote control identification information received from remote control and their 
own object model identification information are transmitted to a server 1041, and transmission of 
UI is requested. 

[0335] Drawing 107 is a flow chart with which remote control does not receive UI from an object 
model directly, but shows the example of the processing [ in / for UI / reception and the 
example to display ] by the side of a server through wireless LAN etc. The flow of processing by 
the side of a server is explained. 

[0336] At step S1071, it stands by until there is a Ul Request-to-Send signal from an object 
model. Ul of the model which object model identification information shows to the remote control 
960 which the remote control identification information received from the object model shows at 
step S1072 is sent. 

[0337] [Operation gestalt 37] When drawing 108 has UI of each device in the wireless LAN 
server 1041 and UI is required towards FAX963 which is an object model about remote control 



960a or 960b, UI which is the request from FAX963 and is different from the wireless LAN server 
1041 for every user to remote control 960a or 960b is drawing in which being transmitted and 
showing the example displayed. 

[0338] The screen of a default is displayed on remote control 960a or 960b in the condition of 
having not turned to the object model, like the center of drawing 108 . This screen is common to 
remote control 960a and 960b. 

[0339] Here, the flow of communication between object models is explained to be a user, and 
remote control 960a or 960b. 

** A user turns remote control 960a or 960b to an object model. 

** In order to determine the timing which sends UI demand signal to an object model from 
remote control 960a or 960b, a user touches the touch panel of remote control 960a or 960b 
etc. Or it is set up so that UI demand signal may always be beforehand sent at fixed spacing. 
** Send both UI demand signals for the remote control identification information (remote control 
A, remote control B) for identifying remote control 960a or the 960b itself, and the user 
identification information (an upper person, beginner) for identifying the user itself to an object 
model. 

** From remote control 960a or 960b, the object model which received remote control 
identification information, user identification information, and UI demand signal sends the object 
model identification information which identifies the object model itself with the received remote 
control identification information and user identification information to the server 1041 which has 
managed the object model. 

** A server 1041 sends UI shown by user identification information and object model 
identification information through wireless LAN etc. to remote control 960a or 960b shown by 
remote control identification information. In the example of drawing 10808 , for the beginner, UI 
for a broadcast function with it difficult [ to use ] is not sent to a beginner, but it has sent only 
to the upper person. 

** Remote control 960a or 960b which received UI of sent addressing to itself displays UI. 
[0340] Although he was trying to transmit a user's level information from remote control, you 
may make it distinguish a user s level from remote control in an object device or a server as user 
identification information, in the above-mentioned example, from the identification information 
which received, as the information which identifies users, such as a user name, according to an 
individual is transmitted. 

[0341] Although the above-mentioned example explained only within UI, if different user 
identification information for every user is referred to, the content of the urgent mail which 
reached the user, a schedule to tell immediately, etc. can be included in UI, and it can transmit 
to remote control. 

[0342] Drawing 109 is a flow chart which shows the example of processing by the side of remote 
control [ in / for UI from which remote control does not receive UI from an object model 
directly, but differs for every user through wireless LAN etc. / reception and the example to 
display ]. The flow of processing by the side of remote control is explained. 
[0343] At step S1091, it stands by until there is directions actuation of a user. The remote 
control identification information for discriminating the remote control itself from UI demand 
signal for having UI sent from an object model at step S1092 and the user identification 
information for identifying the user itself are sent by approaches, such as infrared ray 
communication. At step S1093, it stands by until UI from where is sent Received UI is expressed 
as step S1094. 

[0344] Drawing 110 is a flow chart [ in / for UI from which remote control does not receive UI 
from an object model directly, but differs for every user through wireless LAN etc. / reception 
and the example to display ] which shows the example of processing by the side of an object 
model. The flow of processing by the side of an object model is explained. 
[0345] At step S1101, it stands by until there is a demand signal from remote control. At step 
S1 102, with the remote control identification information received from remote control, and user 
identification information, its own object model identification information is transmitted to a 
server 1041, and transmission of UI is requested. 



[0346] Drawing 1 1 1 is a flow chart [ in / for UI from which remote control does not receive UI 
from an object model directly, but differs for every user through wireless LAN etc. / reception 
and the example to display ] which shows the example of processing by the side of a server. 
Moreover, drawing 1 1 2 is an example of the table having shown UI determined from an object 
model and user identification information. The flow of processing by the side of a server is 
explained. 

[0347] At step S1 1 1 1, it stands by until there is a UI Request-to-Send signal from an object 
model. With reference to a definition as shown in drawing 112 , UI corresponding to object model 
identification information and user identification information is sent to the remote control which 
the remote control identification information received from the object model shows at step 
S1112. 

[0348] [Operation gestalt 38] Drawings 113 and 114 are drawings showing the example which 
realizes the function which the model for actuation before an eye does not have. The flow of 
communication between the user of this example, remote control, and an object model is 
explained. 

** A user turns remote control 960 to an object model, and specifies the function to want to 
carry out 

** The model for actuation which received the demand from remote control 960 tells the 
demand to a server 1041. 

** A server 1 041 sends UI of the model corresponding to the demanded function. 
** Remote control 960 displays UI which received. 

** A user operates it according to directions of UL In the case of this example, a user sets a 
document to send to the copy machine 962 before an eye, and directs and performs the 
destination with remote control 960. 

** Ask other devices to be for that he can do it to perform the device for actuation by itself, 
and impossible [ the thing of it ] by yourself. In the case of this example, a copy machine 962 
performs reading of a document, but since FAX transmission cannot be carried out, the content 
of operator guidance, such as a transmission place, is sent to FAX963 with document data. 
** FAX963 carries out FAX transmission at the transmission place which had sent document 
data specified according to directions. 

[0349] In order to determine the device which requests the function which cannot do a copy 
machine 962 by itself in the above-mentioned example, it may be made for each device to have 
the information about the function of other devices, and you may make it determine, as a result 
of asking whether the function can be performed to each device on a network. Or you may make 
it ask the server 1041 with the information of a function and a corresponding model. 
[0350] [Operation gestalt 39] In the reasons of there being an obstruction in the middle of the 
model for actuation, and remote control before an eye, drawing 115 is drawing showing the 
example which tries indirect communication in other paths, when remote control does not have a 
model for actuation, and direct communication ****. 

[0351] Here, the flow of communication between a user, remote control, and an object model is 
explained. In addition, ** to ** is not indispensable at the following explanation. For example, the 
same effectiveness is realizable if the object model has always emitted the signal towards 
remote control at fixed spacing by **. That is, only the indispensable part is illustrated in drawing 
115. 

[0352] ** A user turns remote control 960 to an object model. 

** In order to determine the timing which sends UI demand signal to an object model from 

remote control 960, a user touches the touch panel of remote control 960 etc. Or it is set up so 

that UI demand signal may always be beforehand sent at fixed spacing. 

** Send UI demand signal to an object model from remote control 960. 

** If the object device is set up according to the demand of UI demand signal from remote 

control 960 so that UI may always be beforehand sent at fixed spacing, it will send UI according 

to the setting out 

** The remote control 960 which received UI displays UL 

** Here, with remote control 960, when being set up so that the fixed time amount progress 



back may be spent from UI demand signal transmission and UI may be spent at fixed spacing and 
Ul is not sent during more than the spacing, send UI demand signal by alternative pathway, [n 
this example, when communication by the infrared signal cannot be realized, communication 
using wireless LAN is tried. 
** Display acquired UI through wireless LAN. 

[0353] In the reasons of there being an obstruction in the middle of the model for actuation, and 
remote control before an eye, drawing 1 1 6 is a flow chart which shows the example of the 
processing by the side of remote control in the example which tries indirect communication in 
other paths, when remote control does not have a model for actuation, and direct communication 
****. The flow of processing by the side of remote control is explained. At step S1 161, it stands 
by until there is directions actuation of a user. The remote control identification information for 
discriminating UI demand signal and the remote control itself for having UI sent from an object 
model at step S1 162 is sent by the infrared approach. At step S1163, it is confirmed whether UI 
was received or not. At step S1 164, it is confirmed after demand transmission whether fixed 
time amount progress was carried out The remote control identification information for 
discriminating the remote control itself from UI demand signal for having UI sent from an object 
model at step S1 165 is sent by different approaches from the dispatch path in step S1 162, such 
as wireless LAN. Received UI is expressed as step S1166. 

[0354] In this case, by the wireless LAN server 1041 which received UI demand signal, although 
UI demand signal directly transmitted to the model for actuation itself will be sent to the wireless 
LAN server 1041, since the model for actuation is unknown, the menu for choosing a model 
(function) is displayed first And UI corresponding to the selected model is displayed. The 
wireless LAN server 1041 receives a model selection signal from remote control 960, and you 
may make it this UI transmit UI corresponding to that model to remote control 960, and may 
make it transmit two or more selectable UI from that menu with said menu. 
[0355] [Operation gestalt 40] Drawing 1 1 7 is drawing showing the example which saves as 
hysteresis the actuation and action which the user performed, and time of day with the 
important information in connection with it 

[0356] Here, it explains the actuation and action which the user performed, and flowing when 
saving time of day as hysteresis with the important information in connection with it 
** A user sets a document to FAX963 and directs to transmit to Mr. a of A company with a user 
(addresser) name. 

** FAX963 is a document by directions of Mr. Tom while transmitting a document according to 
directions. The data sent to Mr. a are told to a server 1041 with the sent document and sending 
time of day. 

** A server 1041 saves the received data as hysteresis information while saving the received 
document as a file [File ABC] of a suitable identifier. 

[0357] Drawing 118 is a flow chart in the example which saves as hysteresis the actuation and 
action which the user performed, and time of day with the important information in connection 
with it which shows the example of processing by the side of remote control. The flow of 
processing by the side of remote control is explained. 

[0358] At step S1 181, it stands by until there is directions actuation of a user. The remote 
control identification information for discriminating the remote control itself from the demand 
signal over the directions actuation which the user performed at step S1182, and the user 
identification information for identifying the user itself are sent by approaches, such as infrared 
ray communication. At step S1183, it stands by until Ul from where is sent Received UI is 
expressed as step S1184. 

[0359] Drawing 119 is a flow chart which shows the example of the actuation and action which 
the user performed, and the processing by the side of an object model in the example which 
saves time of day as hysteresis with the important information in connection with it The flow of 
processing by the side of an object model is explained. 

[0360] At step S1191, it stands by until there is a demand signal from remote control 960. At 
step S1192, processing corresponding to the demand signal from remote control 960 is 
performed. In the case of the example of drawing 1 1 7 , the document which the user set will be 



read and it will transmit to Mr. a of A company. At step S1 193, the remote control identification 
information received from remote control 960, user identification information, their own object 
model identification information, and the important information related to performed action are 
transmitted to a server 1041. In the case of the example of drawing 1 1 7 , it is a document by 
directions of Mr. Tom. The sending document itself which is the important information in 
connection with this data for the data sent to Mr. a is transmitted to a server 1041 with sending 
time of day. 

[0361] Drawing 120 is a flow chart in the example which saves as hysteresis the actuation and 
action which the user performed, and time of day with the important information in connection 
with it which shows the example of processing by the side of a server. Moreover, drawing 121 is 
drawing showing an example of the updated hysteresis information as a result of this processing. 
The flow of processing by the side of a server is explained. 

[0362] At step S1201, it stands by until there is a demand signal from an object model. At step 
S1202, the important information in connection with the received data is saved. Document with 
which Mr. Tom directed transmission in the case of the example of drawing 1 1 7 File ABC It 
saves by carrying out 

[0363] At step S1203, hysteresis information is updated according to the received data, the case 
of the example of dr awing 1 1 7 — Mr. Tom — 1996/7/5 — having sent the document to Mr. a of 
A company is recorded on 10:00 with the file name saved at step S1201. the data that drawin g 
121 is the example of the updated hysteresis information, and Mary copied the 10 section of 
FileXYZ(s) to 1996/7/3 — 1996/7/5 — the data that Mr. Tom transmitted File ABC to Mr. a of 
A company are added to 10:00. UI that processing was completed correctly is sent to the remote 
control which the remote control identification information received from the object model shows 
at step S1204. 

[0364] [Operation gestalt 41] Fig. 122 and 123 is drawing showing the example which performed 
hysteresis and operated it to origin, after saving [ action / which the user performed / the 
actuation and action ] time of day as hysteresis with the important information in connection 
with it 

[0365] Here, after saving [ action / which the user performed / the actuation and action ] time 
of day as hysteresis with the important information in connection with it it explains flowing when 
having performed hysteresis and operating it to origin. 

** Direct that remote control 960 shows Mr. Tom's hysteresis toward a copy machine 962. 
** A copy machine 962 tells that it shows Mr. Tom's hysteresis as the server 1041 which 
manages hysteresis based on these directions. 

** A server 1041 sets to U[ only hysteresis with which Mr. Tom was concerned with reference 
to hysteresis information, send to a copy machine 962, and a copy machine 962 transmits this UI 
to remote control 960. 

** Mr. Tom chooses specific data out of the hysteresis currently displayed on remote control 
960, and he directs action. Since the data sent to A company are before needed anew in the 
case of this example, the data of "having transmitted File ABC to Mr. a of A company" tend to 
be chosen out of hysteresis, and it is going to pick out that data from the copy machine 962 in 
front of an eye by directing a "copy" as action. 

** A copy machine 962 tells directions of "copying File ABC" from a user to a server 1041. 
* ** A server 1041 sends a corresponding document "File ABC" to a copy machine 962. 
** A copy machine 962 prints the document received from the server 1041. 
[0366] Although he was trying to choose the data of "having transmitted File ABC to Mr. a of A 
company" out of hysteresis in the above in order that a user might pick out required data from 
the copy machine 962 in front of an eye When the name "File ABC" of a document to output is 
known, it replaces with hysteresis and the list of files is displayed, a file name can be chosen 
from the inside, or a direct file name can also be inputted. 

[0367] Moreover, it can also be aimed at the document saved at PC on a network although 
considered as the document which saved the document to take out above at the server 1041 
while transmitting by FAX963. 

[0368] Drawing 124 is drawing showing the example of a configuration of the remote control 960 



used with the above operation gestalt 

[0369] 1241 is a display and displays with liquid crystal. Furthermore, the resistance film is 
attached to the display 1241 and information can be inputted using a pen 1242. This input may 
choose the carbon button on a screen with a pen 1242. Furthermore, a character recognition 
function can be prepared and the alphabetic character written with the pen 1 242 can also be 
inputted. 

[0370] The inputted information can be transmitted to other devices from the communications 
department 1243. Moreover, the interior of equipment is equipped with the storage section 1245 
with CPU1244 for control, and the information received from input or the communications 
department 1243, the hysteresis of actuation, etc. are memorized. A SRAM card, SIMM, HDD, 
etc. can be used as the storage section 1245. Moreover, it is dc-battery actuation and is 
dripproof. 

[0371] Drawing 1 25 is drawing showing other examples of a configuration of the remote control 
960 used with the above operation gestalt 

[0372] 1251 is a display and displays by liquid crystal or CRT, Furthermore, a touch panel can 
also be added to a display 1251 as an option. Thereby, information can be inputted using a finger, 
a pen, etc. 1252 is the input section which inputs information by actuation of a carbon button. 
The inputted information can be transmitted to other devices from the communications 
department 1253. Moreover, the interior of equipment is equipped with the storage section 1255 
with CPU1254 for control, and the information received from input or the communications 
department 1253, the hysteresis of actuation, etc. are memorized. A SRAM card, SIMM, HDD, 
etc. can be used as the storage section 1255. 

[0373] Remote control of drawing 1 25 can be used as carbon button remote control, even if it 
removes the storage section 1 255. Moreover, even if it removes the communications department 
1253, it can be used as an electronic memo pad (PC). Moreover, using a touch panel, even if it 
removes the input section 1252, as shown in drawing 124 , it can be used. 
[0374] Drawing 126 is drawing showing other examples of a configuration of the remote control 
960 used with the above operation gestalt 

[0375] 1261 is a display and displays with liquid crystal. 1262 is the input section which inputs 
information by actuation of a carbon button. The inputted information can be transmitted to 
other devices from the infrared communications department 1263. Moreover, the interior of 
equipment is equipped with the storage section 1265 with CPU1264 for control, and the 
information received from input or the infrared communications department 1263, the hysteresis 
of actuation, etc. are memorized. A SRAM card, SIMM, HDD, etc. can be used as the storage 
section 1255. Furthermore, PCMCIA slot 1266 is formed, for example, a PCMCIA card is 
inserted, it becomes connectable according to a PCMCIA bus, and two communication paths can 
be used. Moreover, the infrared communications department 1263 is only transmission by 
luminescence, and you may make it reception use a PCMCIA bus. Of course, it is not necessary 
to use connection by the PCMCIA bus. 

[0376] In addition, in the range which can realize the function of the above-mentioned operation 
gestalt even if it applies this invention to the system which consists of two or more devices (for 
example, the body of a computer, an interface device, a display, etc.), it may be applied to the 
equipment which consists of a single device. Moreover, it aims at operating various devices so 
that the function of the operation gestalt mentioned above may be realized. To the computer in 
the equipment connected with these various devices, or a system The program code of the 
software which realizes the function of the operation gestalt mentioned above is supplied, and 
the supplied program is followed. By computer (or CPU and MPU) of the system or equipment 
What was carried out by operating said various devices is contained in the range of the invention 
in this application. Moreover, that program code itself and a means, for example, the storage 
which memorized this program code, to supply that program code to a computer will constitute 
this invention by realizing the function of the operation gestalt which the program code itself by 
which reading appearance was carried out from the storage in this case mentioned above. 
[0377] As a storage for supplying this program code, a floppy disk, a hard disk, an optical disk, a 
magneto-optic disk, CD-ROM, CD-R, a magnetic tape, the memory card of a non-volatile, ROM, 



etc. can be used, for example. 

[0378] Moreover, also when the function of the operation gestalt mentioned above by performing 
the program code which the computer read is not only realized, but it collaborates with OS 
(operating system) which is working on a computer, or other application software based on 
directions of the program code and the function of the above-mentioned operation gestalt is 
realized, it cannot be overemphasized that this program code is contained in the range of the 
invention in this application. 

[0379] Furthermore, after the program code by which reading appearance was carried out from a 
storage is written in the memory with which the functional expansion unit connected to the 
functional add-in board inserted in the computer or a computer is equipped, it is needless to say 
in being contained also when the function of the operation gestalt which performed a part or all 
of processing that the CPU with which the functional add-in board and functional expansion unit 
are equipped based on directions of the program code is actual, and mentioned above by the 
processing is realized. 

[0380] What is necessary is just to store in the storage the program code corresponding to the 
flow chart explained previously, when applying the invention in this application to the above- 
mentioned storage. 



[Translation done.] 



* NOTICES * 
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[Brief Description of the Drawings] 

[Drawing 1] It is drawing showing the system configuration of an operation gestalt. 
[Drawing 2] It is drawing showing the functional configuration of an operation gestalt 
[Drawing 3l It is drawing showing the hardware configuration of each equipment of an operation 
gestalt 

[Drawing 4] It is the flow chart which showed the flow of processing of an operation gestalt 
[Drawing 5] It is drawing having shown the flow of the processing which chooses the optimal 
printer from two or more printers, and performs printing. 
[Drawing 6] It is drawing explaining the case where remote control is used. 

[Drawing 7] It is drawing showing the example at the time of reading a document from a scanner 
and transmitting to a specific printer. 

[Drawing 8] It is drawing showing the example at the time of transmitting to the specific printer 
which reads a document from a scanner and cannot manage a scanner.. 

[Drawing 9] It is drawing showing the example at the time of transmitting to the specific printer 
which reads a document from a scanner and cannot manage a scanner. 

[DrawingJO] It is drawing showing the example at the time of transmitting to the specific printer 
which reads a document from a scanner and cannot manage a scanner. 

[Drawing 11] It is drawing showing the example in the case of notifying the condition of a printer. 

[ Drawing 1 2 1 It is a flow chart showing the procedure of the operation gestalt 8. 

[Drawing 13] It is drawing showing the case where the information to file is told to a user in 

advance by filing processing. 

[Drawing 14] It is drawing showing the case where judge the necessity of received data and 
unnecessary information is canceled. 

[Drawing 15] It is the flow chart which shows the procedure of the operation gestalt 9. 

[Drawing 16] It is drawing showing the information flow of the operation gestalt 9. 

[Drawing 17] It is a flow chart showing the detailed procedure of JOB activation. 

[Drawing 18] It is drawing showing the example of the extra sensitive information to read. 

[Drawing 19] It is drawing showing the example of a JOB table. 

[Drawing 20] It is drawing showing the example of Printing Window. 

[Drawing 21] It is drawing showing the example of a JOB table. 

D>awi n g_22] It is drawing showing the content of <file A>. 

[Drawing 231 It is a system configuration ****** Fig. 

[Drawing 24] It is drawing showing the example of Question Window. 

[Drawing 25] It is drawing showing the example of a JOB table. 

[Drawing 26] It is drawing showing the example of schedule data. 

[Drawing 27] It is drawing showing the example of an inquiry to a user, 

[Drawing 28] It is drawing showing the example of a JOB table. 

[Drawing 29] It is drawing showing the example of a JOB table. 

[DrawingJO] It is drawing showing the example of change of the status of a printer. 

[Drawing 31] It is drawing showing a printer status table. 



[Drawing 32] It is drawing showing the example of a JOB table. 

[Dra wing 33] It is drawing showing the example of Question Window. 

[Drawin g 34] It is drawing showing the example of a JOB table. 

[Drawing 35] It is drawing showing the example of change of the status of a printer. 

[Drawing 36] It is drawing showing the rule of a plan and action. 

[Drawing 37] It is drawing showing the rule of a plan and action. 

[Drawing 38] It is drawing showing action and the prerequisite over the object. 

[Drawing 39] It is drawing showing the example of the property of each device. 

[Drawing 40] It is drawing showing the example of the status of each device. 

[Drawing 41] It is drawing showing the condition that two or more equipments are connected to 

the network. 

[Drawing 42] It is drawing showing the functional configuration for processing the operation 
gestalt 1 4. 

[Drawing 43] It is the flow chart showing the flow of processing of the operation gestalt 14 of 
Maine. 

[Drawing 44] It is a flow chart showing the flow of the processing when controlling other 
equipments. 

[Drawing 45] It is a flow chart showing the flow of processing in the case of processing with its 
own equipment 

[Drawing 46] The directed printer is drawing having shown the example which outputs by 
different printer. 

[Drawin g 47] The directed printer is drawing having shown the example which transmits JOB to 
other printers. 

[Drawing 48] A users printer is drawing having shown the example which transmits JOB to the 
printer of a user's going-out place. 

[Drawing 49] It is the flow chart which showed the flow of processing of the operation gestalt 1 6. 

[Drawing 50] It is the conceptual diagram of processing of the operation gestalt 1 6. 

[Drawing 51] It is drawing showing the flow of JOB of the operation gestalt 17. 

[Drawing 52 ] It is a flow chart showing the flow of processing of the print JOB automatic setting 

section. 

[Drawing 53] It is drawing showing two or more printing time amount and amount of the toner 
used per character of the printer used. 

[Drawing 54] It is drawing showing the parameter which the user specified as the content of the 
print JOB. 

[Drawing 55] It is a flow chart showing the flow of processing of the print JOB automatic 
modification section. 

[ Drawing 56] It is drawing showing the parameter which the user specified as the content of the 
print JOB. 

[Drawing 57] It is drawing showing the flow of JOB of the operation gestalt 19. 

[Drawing 58] It is drawing explaining the example which sets up the parameter of Print JOB 

using natural language. 

[Drawing 59] It is drawing explaining the example which sets up setting out of the parameter of 
Print JOB by the document itself. 

[Drawing 60] It is drawing showing the flow of JOB of the operation gestalt 21. 

[ Drawing 61 ] It is the flow chart of processing by the print JOB simulation section. 

[Drawing 62] It is the flow chart of the procedure of the printer system of the operation gestalt 

22. 

[Drawing 63] It is the external view of the printer of the printer system of the operation gestalt 
22. 

[Drawing 64] It is the flow chart which shows the procedure of the operation gestalt 23. 
[Drawing 65] It is drawing showing the functional configuration of the system of the operation 
gestalt 23. 

[Drawing 66] It is drawing showing the class [ exterior / which perform overall processing of the 



operation gestalt 23 / the system and the exterior ] of S/O. 

[Drawing 67] It is drawing showing the example which extracts a schedule from an electronic 
mail 

[Drawing 68] It is the flow chart which shows the concrete procedure of the operation gestalt 
23. 

[ Drawing 69] It is drawing showing the example with which a schedule collides. 
[D rawing 70] It is drawing showing an example when a user questions a system with voice. 
[Drawing 71] It is the flow chart which shows the procedure of the operation gestalt 24. 
[Drawing 72] It is drawing showing the example which adjusts the schedule which collides. 
[Drawing 73] It is the flow chart which shows the procedure of RIPURANNINGU of the schedule 
which collides. 

[Drawing 74] It is the flow chart which shows the procedure of RIPURANNINGU of an answer. 
[Drawing 75] It is drawing showing a whole image also including I/O of the system of the 
operation gestalt 26. 

[Drawin g 76] It is a flow chart showing the flow of processing of the whole system of the 
operation gestalt 26. 

[Drawing 77] It is a flow chart showing the flow of processing of the input Management section. 

[Drawin g 78] It is a flow chart showing the flow of processing of the Core section. 

[Drawing 79] It is a flow chart showing the flow of processing of the output Management section. 

[Drawing 80] It is a flow chart showing the procedure of data extraction processing. 
[Drawing 81] It is drawing showing the example of the document set as the object of data 
extraction processing. 

[Drawing 82] It is drawing explaining specific block reading processing. 

rD rawing 83] It is the flow chart which shows the decision procedure of processing in which the 
date data were referred to. 

[Dr awin g 84] It is drawing showing the information flow of the operation gestalt 27. 

[Drawing 85] It is drawing showing the information flow of the operation gestalt 28. 

[Drawing 86] It is drawing showing the information flow of the operation gestalt 28. 

[Drawing 87] It is the flow chart which shows the procedure of the operation gestalt 28. 

[ Draw ing 88] It is drawing showing the information of the common knowledge base. 

[Drawing 89] It is drawing showing the information of the knowledge base of the field specified as 

the cover page. 

[Drawing 90] It is drawing showing the example which performs processing with reference to the 
hysteresis performed in the past with voice. 

[Drawing 91] It is the flow chart which shows the flow of processing of the operation gestalt 30. 
[Drawing 92] It is drawing showing the example of an input-statement document. 
[ Draw ing 93] It is drawing showing the content of the conversation of a system and a user. 
[Drawi n g 94] It is the output-statement document which the system drew up, judging from 
conversation. 

[Drawing 95] After asking a user, it is the flow chart of the example which carried out automatic 
activation of the required processing. 

[Drawin g 96] It is drawing showing the operation gestalt which operates a system with remote 
control. 

[Drawing 97] It is drawing showing the example of a status monitor. 

[ Drawing 98 ] Remote control recognizes an object model and is drawing showing the example 
which displays corresponding Ul. 

[Drawing 99] Remote control recognizes an object model and is the flow chart of the processing 
by the side of remote control in the example which displays corresponding UL 
[D rawin g 100] Remote control recognizes an object model and is the flow chart of the 
processing by the side of an object model in the example which shows corresponding UL 
[Drawing 101] Remote control is drawing showing reception and the example to display for UI 
from an object model. 

[Drawing 10 2] Remote control is the flow chart of the processing [ in / for an object model to 



UI / reception and the example to display ] by the side of remote control 

[ Drawin g 103 ] Remote control is the flow chart of the processing [ in / for an object model to 

UI / reception and the example to display ] by the side of an object model. 

[Drawing 104] Remote control is drawing in which not receiving UI from an object model directly, 

but showing reception and the example to display for UI through wireless LAN etc. 

[Drawing 105 ] Remote control is the flow chart of processing by the side of remote control [ in / 

through wireless LAN etc. / for UI / reception and the example to display ]. 

[Drawing 106] Remote control is the flow chart which shows the example of the processing [ in / 

for UI / reception and the example to display ] by the side of an object model through wireless 

LAN etc. 

[Drawing 107] Remote control is the flow chart which shows the example of the processing [ in / 
for UI / reception and the example to display ] by the side of a server through wireless LAN etc. 

[Draw i ng 108] It is drawing showing reception and the example to display for UI from which 
remote control differs for every user through wireless LAN etc. 

[Drawing 109] It is the flow chart of processing by the side of remote control [ in / for UI from 
which remote control differs for every user through wireless LAN etc. / reception and the 
example to display ]. 

[ Drawing 110] It is the flow chart of the processing [ in / for UI from which remote control 
differs for every user through wireless LAN etc. / reception and the example to display ] by the 
side of an object model. 

[Drawing 111] It is the flow chart of the processing [ in / for UI from which remote control 
differs for every user through wireless LAN etc. / reception and the example to display ] by the 
side of a server. 

[Drawing 112] It is drawing showing the table having shown UI determined from an object model 
and user identification information. 

[Drawi ng 113] It is drawing showing the example which realizes the function which the model for 
actuation before an eye does not have. 

[Drawing 114] It is drawing showing the example which realizes the function which the model for 
actuation before an eye does not have. 

[Drawing 1 15] It is drawing showing the example of a response when there are not a model for 
actuation before an eye and direct communication ****. 

[Drawing 116] It is the flow chart of processing by the side of remote control of the operation 
gestalt 39. 

[Drawing 1 1 7] It is drawing showing the example which saves as hysteresis the actuation and 
action which the user performed, and time of day with the important information in connection 
with it 

[Drawing 118] It is the flow chart of processing by the side of remote control of the operation 
gestalt 40. 

[Drawing 1 1 9] It is the flow chart of processing by the side of the object model of operation 
gestalt 40. 

[ Drawing 120] It is the flow chart of processing by the side of the server of the operation gestalt 
40. 

[Drawing 121] It is drawing showing an example of the updated hysteresis information. 
[Drawing 122] It is drawing showing the example which operated it based on hysteresis. 
[Drawing 123] It is drawing showing the example which operated it based on hysteresis. 
[Drawing 124] It is drawing showing the example of a configuration of remote control. 
[Drawing 125] It is drawing showing the example of a configuration of remote control. 
[Drawing 126] It is drawing showing the example of a configuration of remote control. 
[Drawing 127] It is drawing showing the information which specified whether an advance 
notification would be performed. 

[Drawing 1 28] It is drawing showing an information flow in case the equipment according to the 
object of JOB does not exist. 

[ Drawi ng 129] It is drawing showing the example of a display of the window which proposes the 



optimal approach to a user. 

[ Drawin g 130] It is drawing having shown the semantics which the character string in a 
parameter setup expresses, and a demand item required in order to complete the semantics. 
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To : Macrohanl Conx 

Attn : Mr. John Sntti 

Tel : 001 -1- (41S) -394-1111 

Fax: 001- I - (415) -394 - 2312 



Fran : Cflftrifi inc. 

Sender : Dr. Rohra 

Tel: +81-44-649-6339 
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Thank you far your phono call this naming. 
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!The content of amendment] 

;Claim(s)] 

§| 1] 

A receiving means to receive 



f^r- ; ::-/-:^/li;^ 

;eive information, 

_ yyyyyyyyyyy 'yy^'y/y y\.yy ■ ■ yyy.yyyy- ■': :\yy,:'-y:yi:[yy-y:-. : :]:yyy ..yy.-i ]i-'y 'y\:yf\-y yy^y yyy V-^fyy.^^y .: -yyy: y:\pyy :.y-'y. [ ]y'yyy\yy[ -y-y'^yy-y :-x 

An analysis means to analyze the received information, 
A decision means to opt for the* processing which should be performed based on the analysis 
result of this analysis means, 

An activation means to perform said processing for which it opted, 
A recognition means to recognize a situation, 





[Claim 3] 

The information processor according to claim 2 characterized by having an advice means to 
notify a user of having" directed : act ivAtinn :nf c^ ( i n^^^;^ *. : ^ : l. _ • • . . . . ■ 



ba.d situation is an information processor according to claim 1 characterized by including the i 
own situation of equipment. ' , ' " ; • - ' - . . . • - , 

[Claim 5] 

Said situation is an information processor according to claim 1 characterized by including the 
Situation of other equipments. ^ - ' - - ; 

(.Claim 6 J > 

Said situation is an information processor according to claim 1 characterized by including a 
user's situation. 

[Claim 7] | ' ; 

Said termination means is an information processor according to claim 1 characterized by 
stopping activation of the processing nonrernpH wh^n +h<* r^r^o^;~~ t u:^u _ ^ ... 



processor according to claim 1 characterized by 

---rr---* — ■ — — w.icerned when the processing for which it opted with said 

decision means is the processing which is not permitted for the user recognized by said 
recognition means. 
[Claim 9] 

Said termination means is an information processor according to claim 1 with which processing 
for which it opted with said decision means is characterized by stopping activation of the 
processing concerned when the user recognized by said recognition means is processing for a 
different user. 

said decision means should perform said processing with other equipments rather than said 
actuation means — ** — when it judges, it should perform with said activation means — not 
coming out — judging — said directions means — activation of said processing — said — 
others — the information processor according to claim 2 characterized by what is directed to 
equipment. 

The information processor according to claim 1 characterized by having an advice decision 
means to judge whether a user is notified of activation of the processing concerned in advance 
of activation of said processing, based on said analysis result ' 
[Claim 12] 

the case where activation of said processing is directed to other equipments — being concerned 

others — the information processor according to claim 2 which will be characterized by 
rerunning decision by said decision means if directions are refused from equipment 
[Claim 13] 

It is the information processor according to claim 2 characterized by to direct activation of said 
processing to other equipments when it is judged that it is appropriate to have an equipment 
decis.on means to judge whether it is appropriate to recognize the situation of equipment itself 
and other equipments with said recognition means, and to perform with which equipment from 
the recognized situation, and to perform with other equipments 
[Claim 14] 

The information processor according to claim 13 characterized by having a proposal means to 
form an alternative and to propose to a user when activation by which equipment is also judged 
not to be suitable by said equipment decision means. 
[Claim 15] 

The receiving process which receives information. 



The analysis process which analyzes the received information, 
The decision process which opts for the processing which should be p~ 

yn^^^^jt:-of this analysis process, 

The activation process which performs said processing for which it op 
The recognition process which recognizes a situation, . ;; : . \ ■ — : ^ , 

The decision process which judges whether said processing should be performed according to 
said activation process based on said analysis result and said situation. 

The information processing approach characterized by having the termination process which 





1B1^ 

The information processing approach according to claim 15 characterized by having 1 
~ u-.^u -J---ts activation of said processing to other equipments. 

The information processing approach according to claim 16 characterized by having the advice 
nm^Q<; whir.h nntifip.Q a i i**r of h^vinp- directed activation of said Drocessine: to eauiDment 



[Claim 183 ' f 

Said situation is the information processing approach according to claim 15 characterized by 
including the own situation of equipment. - ; ■ V'-vK }. ;: :^Y^0->\ : '" 
[Claim 19] 

Said situation is the information processing approach according to claim 15 characterized by 
including the situation of other equipments. 
[Claim 20] 

Said situation is the information processing approach according to claim 1 5 characterized by 
including a user's situation. 
[Claim 21] 



r ., : : 



accor 
I termination 

according to said decision process is the processing unnecessary for a user recognized 
according to said recognition process. 

[Claim 22] 

The information processing approach according to claim 15 characterized by stopping activation 
of the processing 



lG!asm.23j 

The information processing approach according to claim 15 characterized by the processing for 
which it opted according to said decision process stopping activation of the processing 



con 




which judges that it does not come out and is characterized by the t 
according to said activation process, and for which activation of said processing is directed to 
other equipments at said directions process when it judges. 
[Claim 25] 

The information processing approach according to claim 15 characterized by the advice decision ; 




characterized by rerunning decision by said decision means if directions are refused from 
equipment. . 
[Claim 27] 

It is the information-processing approach according to claim 24 characterized by to direct 
activation of said processing to other equipments when it is judged that it is appropriate to have ; 
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#!«©J:5^»«l^«WfU, J OB^^fT-f-6^^ 
ftiiioTtt, JOB|l^1-6r^ii£fr^<^M£ 

[0 0 7 3] Wttra0»M<oti^*s4>ofc» 

[0 0 7 4] HI 7l4JOBHfT^ai^Mg^ip-r 
7D~f t-ht*$)6, 40 
[0 0 7 5] Xx^^S170T\ ^^tlfcJOB^ 

fTt|BIJB*Stt»t*U*, *7^:/Sl75X\ JOBtrHfTi- 
60 WH^fciiff, ^X5/ysi72T% MUfclBll:* 

— f 6 ?k job tnnfi&tes-r & fczmm-t 

[0 0 7 6] iUT. PC101O3.-Wx X*-f^l02X 
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m&%. mis, i7ni^>trat5, ®i8tt, 

[0 0 7 7] *1\ ^^•Y^-102T*(1 > T^yT'SlSO 
X% flMft$r**lr>'U ^y^^l04li»aS:igfS^6 
J OB^a o ^x^^S151T% JOBr-^/Hi: 
JOB£iiflp-f £<, Xxi/7"S153X% JOB£&t)££i 
"To *ry^S154X\ T-*£**^U i^f-f^J 

oBtfcs: tzmm-rz,, ^ry^sissx, s^me 

[00 7 8] ^x^yS155X\ te^ICjOB^ih) 

[0 0 7 9] X^ry7°S\70X\ tt^^^^-^VUfci^ 

:/S171X\ J OB<0HfT^tt^S* s *)5o ^T^^S172 
X% JOB (ttfcfc^ir^LTtttfrr*^) 
-fS^IBrf*. ^X^^S173T\ JOB^S^fT^ 
<7)X*X;y;/Sl76^M£^1- 0 Xx ;y:/Sl76X\ JO 

[0080] Nita-c, ^0^fi.« 

[0 0 8 1] C^JS^ 11) 14 KtfcoX, fcMOflg 

A**ixfcrt#«:jWr-r*fc«>©, A^ftf JOB $r 

7rS113tfJWf^ri6ft JOBWIt6 0 Xf 3^7^114 
X\ JOB4rSlfT$*J:5fcLfc**fc/jJ6itt«:31jW 

[0 0 8 2] ^x^ySH5X\ A*S*tfcrt*^ 
~V^U ^x^^S116X\ iK«/ibff*fc*:jOB* 

ii3dD-rs 0 ^7"^^sii7-sii9x% xryTsmxyy 
^=v^$^fcrt*icufc*sortoa«rStfrrs. jo 

B < /jj -6 * ?) iS U 4 < ^0 fc P>^r 3/ ^Sl 10 
[0 0 8 3] <file k>Z%\Ml,£otU^ 
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^CO^t, ift^-T6o 12 211 <file A><7)ft££iE 
fc>-f0X£>9, &<D&<0&ft&*7-X*mfrtlX\i*Zt 

i\ ii#&?:/y ux^/^p^y ^*2303#sg: 

tlX^Zo 

[0 0 8 4] *7^7 B Sl09-C\ JOB7-^Wl:t 
£ 0 ^-ry^SUlT% AaaM*t>»**fcfT*>*L5 JO 
B^JOBx~^/KCiiJtJD-r^(l^l9) 0 *fc, 

Windows 7 7 >(H <fileA>£*t£U %lffl%M$l 
-f-5^s X^^ySllO-C, AatffcSfc^JBrStb*^* 
ysin^iiifo ^ry7 p SUl"C% 0 2 i fc^f J: 5 

A^fcW JOB^JOB r-^/MCiiAD-rS (021). 

JOB:A^ "TOJ <file A>"tf)##f £&*#-f 5« *x 
y^SM4-C, <file A>" ©IWH <file A> 

^TOi-r 6 r t 1* t mm-r 6„ 

[0 0 8 5] XTy-fsmXte, TSBO&ft: • ttfta* 

•<file MZftXy-n&ft&^mtlZmi 2<Dm<D 

• femtimteXy-?}) ^^23O2^#^1-6(0 2 3)„ 

[0086] ^x^^sii9x% r^y-^y> 

\z % jOBf-^W:, fiJffl#©J6HrJisi!llv>»*«>»JS 
O JOB£ii#n-f6(0 2 5) c ^rUT, Xx^/^SllO^ 

[0 0 8 7] *Ty?snQX\ lo^MAAtffci^fc. * 
Ty^SUZXs SWfBitB* JOB^&t* 6*rc\ *x 
^7°SH3-iitf 0 XxyT'SllST', HfT«TfBfcJOB : 

[0 0 8 8] ^xy^lUT\ «ffl#^*«*Sj|Rtx»d 
(DttlfcoBtttt, H**S»tAtfC<tbS*^9^«:3sp 

mis Tfiiffl#^ra^^s - 1 

-f<5 0 

• «Jfl#j&*»fiEl * 6 J§0? 4>H;Ig#^£fcl o X t * 6 (Q 2 
A'T-*T\ l3^P>^fflRlifile A^ffit6)o 

[0089] ^ryysii9T% r^^-^y^ 
*-eBUMu*-ra»?j tRg^t>*5(0 2 7). fw 

J OB&ilJn-f 6(02 8). XT^SHQKliS, 
[0 0 9 0] XTy^SllOT% 0 2 7<D X b ^Jffl#* s 

Ty-fsm^mtto x?y7s\\w* A^tfrjOB 
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£ J OBr-^/H^ii*0i-5(®2 l)o TJryTSMl 

x\ nn^wt s oBtfftfcr*<o-?s x^^sm-. 

iltfo ^x^/^Sin-C, UtT*!^ JOB:A# "I* 
lr\ J:6t<" <r>ffrffi*WfrfZ> Q ^yJSXUX, A 

[0 0 9 1] *X;y7'S115-C\ <file A>^^77~^y > 
*2302{::&oT. £PflH-£Ct£&>rr5o X^-z^Sl 
18 T\ <file A>£;*77-;/y >-*2302Ki£oTTOJ-f 
io |^B#tC JOBx-y/H^ftj^lE^I^TUfc^ 

}£0fr<om&V>Tz.%><O J OB^iiAD-f6(lll2 9) c XT 

[0 0 9 2] Xrs/^SllO-e, A^&U *7^y:/Sll2 
BdM££-r<50-C\ xry^S113— iitfo xry 7*5113 

r% HfTPTig^joB^y y^^7-^^«ifc 

^S^^#-T6o ^fy/S114t% H31<Z)7 p yy^^ 

x-^x^f), ^f-^^. riwm^ti^j hep 

20 JM$jh,fc:£#j&s:/y V9<n h W fc»$ixT^5i:^5 

[0 0 9 3] XXS/^S115T% -rCfcW^WftfJfw* 

16T\ J OBf-^i:W»tf^|l!)(^/:^^ 
bfr<DfeU<Ofr$><D JOB^iiJp-t"5(ia3 2) 0 ^fS' 
ysilO^M6o Xr^/SU0T\ 10^WAA*s*i\ ^ 

•r ^ysi nx\ mm^xm^nztitz-tL s/sti-s 

HfTRlffi*JOB*sflR9Ei-50-e. xxy 7^113^ 
30 iitfo xr^^SllST*. HfT^fE&JOB:™^* 
S^fcSa^^^^ft^-fS, ^r^^S114X\ 0 3 

mm-tz* *tv7s\\5x\ io»wix»*saa?*tfc** 
i:ii^-T6(0 3 3). mmzs jobt-^ 

40 l^fl]ffl#(D^^^Mv ^4&^(7)*tj£(0 J O B t . TOJ#» 
<0 \Z&tz%£<DMfc<D J O B ZmnT Z> (0 3 
4). Xxy^SllOi^MSo 

[0094] xx^^snor% XM*Hb\ ^x^^si 

X\ ^^tt*JOB:»*J«F^S:»*!JI^*UfcJ 
OB©jtiaL«r»»-r5. *r:y:/Sn4T\ PPM»F^5c 

so fcJOB*Bi]Mrt-Sitftffc31j||i-6 0 xx^ysil5 
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[0095] 3 7(1, -fy^JkXfT * >3 Vto 

[0 0 9 6] Mffi##B 2 OOftlfilJ Window K&^T, 

[00 9 7] f lJffl##EI 24^33 <Z)Jf|BJ Window 

[0 0 9 8] H3 7K^t, ^f^^HOlfi!) 
fi, a.— tF©BW*j«-e«>S. *<ofcfc<&ffi$Bfefl=i:L 20 

[0 0 9 9] V^T^O^tD^fi, JWWHS'*^ 

[0 1 0 0] M 3 8(1, 03 7(0— SB4rto^U-W<@ 
[0 10 1] ^-^C0B^$:S^-r-5^i^ A*)#fc 30 

ton tmm*xmm§i r^usij^^^s 

So 

[0 10 2] ^flJfrW:*^-- ^atr^i-tt. TOJ 
6o 

[0 10 3] 

jc&&#z>kku^ m&mmmtistix&v . n 
^mmmm^^^Lx^^zk^m^xh 
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[0 10 4] ^-y^Mxcc^p^T^te, 

f--'<f*¥<Dmjfc\z'&<>x&mmzmTz.kx\ 

[0 10 5] *VX^AK*Sl^Ttt. ^n/^x-rii^ 

[0 10 6] (XttogfBi 2] jtlto&tti i tmc<, 
<file A>«rHl«i-5»*l!:, # y-7V V*j&5Busy<7>4& 

[0 10 7] £1\ All : <file k>"il>hZ>k. 

XhZk-TZo %ZX\ BusyT-*<^6*-C#o*\ 

^ y * n W^-CiffF^-f 6 k^o^y 
y^4t-6 0 r^/^-^y^^ ASBusy r-ih, f» 

usyx*^ < ft 5 * r-#»-r 6. 

[0 10 8] »|13) 
A^J : "<file A>(4, <file k^VZt&lZtllt. " ^fo 

6o *W=-*tR-C, JOBx-y/W-<file A>(DTOJ 
JOB ftl#J^*«:<file A'>IC^jE-r 

T, r^jEM^<file A><7)ft9l^ <file A'>^WJU 

[0109] [$mj&m i 4 ) ^njs^ffin, 

BUffSrfTbftt^^^ir^Ufcii^^, JOB^r 

m<Dmm\^m^xmft+ztcft<DnMmmxhz> 0 

[0 1 1 0] 04 1(1, a»^8id^y 
^^^r^<6^^^Ufc2o^^T*^ f 9, (A)tt, ^ 
^r-rt-41K ^yy^412, 413(7)^g/i»^4am^ 
UZWfrX%Z>mm><»*y bV-?X*hZ> 0 (B)li> ^ 
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mffif$.%7frr®T~hZ> 0 J OB^$l!) ^42Hi > a— If 
*fctttt«)«W»fe JOB&£&S 0 ^kMbtltc JOB 
tt. JOBr-^/H22^a»$tLS, JOB#*rg|$423 
tt, JOBx-^/M22{C^$ttT^6 JOB^r^t) 
ajtt»t6o i&*fi«WPIWrSl5424tt. H«U-Ci^ 

*WMW«M27f4, SKg#^lltt^ft«)tttB«^«: io 

[0 1 1 2] ftjg^7^=^a425tt. JOB<7)Hfr 
fcMLTfHMC^ JOB|imW^426 

tto»i-estfr*"5»*i±. {ty^e^o jobie 

*nS52llfi. ^ff^^O^tr JOB^IUc^ 
£ft^£^-1ft::ilfcrf S« 20 
[0 1 1 3] m 4 3 *±*HlS^jB 4:11^1-6 fc*0«L31 

1\ ^ry^430-e«t, *i]ffl#a>ibOA*l JOB^ ~> 
^f^Wli^T/M^/j:m<0A^JOB^ 

# g # -C^fiJc L fcfr fcfc J O B # h 6 if 5 ^ * y * 

tf. ^^^^S431T\ J OBr-/yH;A^^teJO 
B^ieia-T6 0 ^.r ^/7 P S432T- J OB^-^/K^ JOB 
*s*>6*^S3^ 4>*Uf, ^XyyS433T% JOB&& so 
tJtfJ-fo *x:/:7S434-ett. #;Lk;h,fc^£flWU 

tt, ft^SB^O J OBj&s*>SaMr*J*r LT, fetutf, 
^xs/yS436T*te^g^$«J^-r6o ftttfttf, ^fy 

[0 1 14] 04 4(1, ^^StO^T*, ^r^^S4 

[0 115] ^ri/7 P S440T% JOB + -e»3e$*bfc» 
MOttft£¥TOU :^J»r(:I<J^t, 5/7^441 40 
tftt, »S**tfc»«-(fJOB«rSWTi-srtKrajHds* 
6*^WI»r5 q WHtffttttUf* ^xs/^S442T% 

^ttfcsgicjoB^aim-rs. »ss*tfc»«w* 

fTfclM#*>5»*fctt. x-r^^S443T\ Ht££ti/c 

fcMKiwc**) j o b s:jtfT^riB/i»«***>*Ltf, ^ 

Ts/^S445"e, -tOKfii^JOB^teiSU Xt l ^^S4 
46T\ J OB^$aiiUfcC^^3--ift^i^P-r6o - 

»3e*nfc«a^©»B-e, ^ojoBKBLfcK so 



20 

:/S447T\ SOB<0%to&W*tot£^&mte77y&ft 
[0 1 1 6] HI 4 5H *^V*yi<D*T\ ^fy^ 

[0 117] X^^^SOT*. £^gO$ft£«fTU 
ZfD^m^^^X, XT vTSiSWU, 63£B"CJ0B 

^^S452T% joB^tSo sser-on 

JOB^UffBTIB^SIfi^fctLlf. ^7 y^S445-C% ^ 
CO^EI- JOB£<Ej£U Xx;/:/S446T\ JOB^ 

[0118] @46(1 04 1 <D(A)lZ&\,^X. X^-f 

tiir^^o^^tiitHK x*+i-4\\<6mmwv®Ln 

WaS424fc*3^T, ^*412(rfifeP$&^ELfcfcfc 
t^, ^413^BOS^aUTttl^«:fT^ofc<!: 

[0 1 1 9] 04 7 a, m 4 l(0(B)ic4o^T, X^^r 
« (JOB) >*4\Z\Z.B<»mn t X&&l,tiW,& 

<nmxhz>o 

[0 1 2 0] ^T(-ia4 6, 4 KD^M^rfb^U^. 
[0 1 2 1] H]4 6(7?X^r^^-411^^yy V*412^tB 

^job^mu^ **\-r4\w#mn. 

[0 12 2] *1\ Xxy^S430T% if^^^^r-r^ 
>^4l2^m^^i^I-f6 J OB^^ 0 ^ 
X2/^S43lT\ J OBf-^/H: J OBSrii^n1"-5o * 
ry^S433tf, JOB^^^ai-r o y ^S434T\ r 

JOBt'fo5^^$:i^t5c xx^^S435 
[0 12 3] xr^^S440T\ ^^^tLfcyyy^412 
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S443T\ jt^$^fc^fi-C-fe6^ , y ^412t?tt. JO 
BSrHtTi-S^tdS^iB^fc*. JOB£HfT«Jf£fr 

£<t9, *«-T6, *xy:/S444T\ J OB %n?r^m 
ft?}) V^4l3^5SaUfcOT% ^^4l3T*cOJ OB 10 

[0 12 4] Xt^T^ST*. **-^LfdfM$£:/y 
^^413^LTi^f-r6o X7 t y^S446T% 
fc^rt*»TlfcOT, ^Lfc^K^LT J 
OBOg3E£fTofcrt£iIfc]1-*. £*±T% 
fc JOB^S^^TLfc(DT% &tf> J OB#A2j$*L 

[0 12 6] **-r^411T-fl N Xx5/7 P S430T\ if£R 20 
£**-^:/U y i J>*4U\Z.ffim&mini-Z> J OB^ 
g&5 0 ^r5/^S431T\ J OBr-^H: J OB^rii 
JDU *Ty7S423X\ J0B£&9tt-f 0 ^f^4 
34T\ T-*£X3r-fVU CWJOB^ it^Sftfc 

[0 12 7] *ry:/S440T\ J^Sflfcr/y V^412 30 

**AM*ffiifcmm\zkzzt&im£tiz<ox\ ? 

y ^412©tt»JiBMR35c < f##&2Hrf S r £ **|0r 
^x5/^s44ir% V*412tt8t*l/t^6<D 

X\ imtWi>0bmffT6. *xs/:/S442T\ 

titcmmx&zyv ^?m\zx*v>ucmm&&m 

U JOB£$-f 0 £JLhT\ fl^Sftfc J OB 
[0 12 8] — y i J >*A\2X'ft* ^y^yysm 

x\ s« ufcflMn&wa-rs job^6o ^x^^ 40 

S431T% J 0B7 L -y/K^J0B$rii*D-r5 0 ^r^/ 
S433T\ J OB£#0ttJ*f-. ^X^7 P S434T% gffLfc 

xy^S435T\ (fi«)ifi|KfcAH-5 JOBttftt^Wrf 
[0 12 9] Xt^:/S450T\ &fr<D&&<DftmkJL 
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yS453T\ JOBfcjWTWj:* a^isgmfci&oge 
*« 

[0 1 3 0] ^7 L y7 P S454T% J O B SrfltT^&l/y 

y#4\3%&M,vtz.<DX\ y#mx<D j oB<DM'fr 

tftfttZ* *"ry7SASSX\ 7V A\l\zmt£fr 

-ctfdt$R£7'y ^^4i3i^utf¥^m-reo 

60 ::t'it m^^tcm^m^notc^K mast 

#LTiifc£?T5 J:5lwLTt)J:i\, ^±T*t^£;ftfc 

*r^o. ^y >*4w*®i>r$mm<, &&oitmn 
[01313 u±<Dmmmmxn. &mm&&%h&)\z.s 

£fi. 3.-^*5 job ^^iH-r 6 J: 5 ^Hfiffi*f+»fC« 
mt*>^t*iOBk\^XX-h\^X^W. 'znmz.* 

£2, M3(0^y^^€:^tiJOB^t^^U-C*3^ 
ttlP, CHf^J:9x ^7 t y^s443*fcli^7 t y7 p s4 
53121*51/ JOBKigLfc*l3&£ LT, ^SJtfcfS 
2, ^3<D^y V^^ji^^tU, ^#i5t^¥W£ix 
60 ^(C JOB«rS»tft5^y V^^f"J(C N 

i#^ffl^^^^TOJ^fWT6B2, 13(0 

J:9l:jOBg#li^2, f 30^y ^tZWtfeZfrX 
[0 13 2] ffl&*W}ittW£&&Mn>X~hc>X 

[0133] CIHfe^tRi 5) *HJ6^ttii. yyy^ 

Lfcs&^t j o b znn-t 

Wri-S«ffl^*5V^-c, JOBO^fT^FplM^I^rr^^J 

[0134] :;tii SKAfflf^fte*.*^**— 
y*4i3#£q£-r5[S4 8t^i-aa^«!!3i*tt^-r 

5o 
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[0 13 5] Z<D&&. 04 3<DmfflZ}$^X. ^=r y 
[0 13 6] *ry 7*5450-0, 

mwx'tDmffizmm&hzkPMi-z. ^x>>^s453 

5o ^7 t y^S454-C, HJ^^Jlg^yy VtAMth&Z 

-T6o X^^^S455T\ 7^ ^412(;iifH$£^l-f 
6. ^x^^S456T\ J OB&fe&LfcC££i£?)7n£ 

[0 13 7] *r$/:/S443T\ JOBO^ii5fe^r 

^MLfc^fci'fcfi, y 7*5444 Til, ^rco^g 

tft^fc*?),, ^xs/yS445T^ Vy >^-^ffi^ft^ 
££&U m^-/K£#^FAX£#(:iLT&lf L/c 

[0 13 8] ^<DB# X :y^S446T*H, mrtfcffll^ 

mmLxm^mma-rmi^ fflanM&ejtfc 30 

[0 13 9] ^x^yS443T\ l^UfcPC^F 

*mm-rz>z. t £ j oB^i^ti^^^i^ 

y^lt^U ^X^7 P S448-C, ^<D^y 
Z£?\clsXhJ:\<\ 

[0140] {%mmi e] nu 9 ic, *mmmm<D 

t&mmmZ^'To i4 9 tt N HI4 3<7)7n-ft- hi- 40 
JOB^/^ofcHoM^lt, ^x^^S498~500 

a j o b tmn $ ft-r ott^^j 

BSrftUiiiU-cegft© jOBf-y/H:iiJPU *B¥ 

*nife^«-ett, joB^otttBtr^s-r^o 
[0141] iiiso^ ro^s^ff^^Ex% yy ^ 

^412^ JOB*«firtEUT*3e>1", 7"y ^4l3^#*> J so 
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OBSrl0{WoT^5OT% 7^^*415*5. 7*y >*4 

13^) joB^^«9dtiLT, e^s-e^s-rsm^^fe 
[0142] >?4\5<D&m<Dmti\*sxT<Dm } ox 

hZ> 0 ^xy7 P S492T% JOBIi^Wfel^XTy 

S499T\ yy ^413lHi»t?||fT^rtB<CJOB^*)* 
Ci^iit6 e ^X2/^S500T\ ^y^413A^^r 
<£> JOB&&9&U &&<D JOB-r-^/K^ii*p-r 
60 SfcK* 7^^*413*^ fc9fciJLfcJOB£8'J 
l&-f£ 0 ^X5/^S490T\ JOB^lWl\ 
^S492T\ ft\Zk*&ftXm\\^tcJOBfr&&-rz><n 

x\ job (Dmnzft? TM^i&m%*^y -TSAmcm 

-To 

[0143]^ Mill4, 15-CRWUfc65> 

[0144] mmm 17] @5m, *n»?i§tf> 
[01453 f:f:u ^mmrnxm^x^^yv V h 

JOB £11, WlM^iloT^em &WP»Jft 

#yy ^^#ot^5WJ1\ mmmL^f 

w^r-^^ /yyMOBx^r^-jjyW 

[0 146] H5im^t, ^7^TVh^i/>-510 

-ett, yy^h joBf^fifea55i2r*^yyh jobs:^ 

fifcU yy JOBf5lt^513(ClNoAcA,i2tiUfc 
7^y >MOB5lHfaJ514^J:!9. ^y^hJOB 

[0 14 7] ih-/W^>511T'«, ii^tbX#fc^y 

y joBgib^$i55i7i^u -rx-i^^^tLX 
[0148] yy> h j oB&mm7£®>5nx&. ^y 

-7°y joBetbS3E^5i8x*«, i^mfe^a 

y^hjOBji, T^y > h j oB^^ri/a— y ^^52 
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[0149] r^X\ yii^h J OBgtb|3;£lfl517& 

v h jOBii^JEStfSisicii, yy 
[0 15 0] £fc s 115 1 \z.mLXh2>±i\^ > 

[0151] @52tt, yyvh JOBe«lia:^517 

joBe»KJ&am7-ett, s^$*tfca«*«j£-r6 
«HX\ x-#*fcwg<* t?#5»t«aFttfcBi*J-et 

6 J: 5 * £ g WiWtfe-fZ. 20 
[0 15 2] 0 5 2t'lt ^f^7 p S520T\ ^ 
hcDMrt LX, ftJSWfia* h^H£ffla&fc£r 
6^@&Mfc-f£ 0 ffii^X, *7*Vs521X\ q °p»^ 
£^fc£p n p1tfli^f («itf5) «£U *7-y? 
S522X\ PpgiJI^ra^^ 5 hi~6o * 7^:75523 

x\ ^ * i— h ^ttfefnawra^^^^fc-r^* 

fefflafcv'a 5 h-fS. ^r^7 p S525T% * u 

6o ^fc£*t6*§^f;i, Xx^7 p S526T\ IS^fpf* 30 
^^^Ml- J O B £^3E1- 5 0 
[0 15 3] *x * 7^523* fcfi5Z5T\ fe££*l,fcft[ 

*»fc£*^IM\ *:r «>7"S527X\ &Jtft£XK«rl 
o^6-r o ^r ^yS528X% »££*tfcf n J««fc£;h, 

oX^T-T6 0 

[0154] hj 5 314, ^fKmt^v vzwxo 

[0 15 5] 15 4(1, *3U6^«X*Pn*J$tl5^y V 

fc®-e*>6. ^HJS^ffi^ffll^^rAT-tt, 05 4 
Xmttc^V y\> JOBO^i s gi£/*7*-*i:& 
fot)-frX^y >h JOBi:^tV6o #H»fiX 

7* y y b J OB^JSUa£:fc^&&£T500£*fc LX so 



fc£U ^t4 J ^B°pM«47 7*/Uhffi[^**m^U^^ 

[0 15 6] 1J5 4 0#!X\ ^!JyhJOBii« 
517#jg«l3ax*fc. ^XTy 7^5200 >-:=.:• h 

0m*xy7^200raX7 1 :y7'SXfe9, l^^fcfc 9 CD h 
-J— Si! 1 OOmg 1 200rag X fo 6 0 
[0 15 7] j£^X, *X2/7^521T\ 
ftffftiSSte Wz-ttS) X#J#Hk;U ^X7^S522X% 
WIWl*ffl£5'a*U-h-r<5o 7"y>-*A52l£ 
7^ V*B522f4ft*J^fEX-*>!9. TT/hJOB^^v? 
a— y ^^XX^^zL-yU^tlX^S^y V h JOB^ 

i o t & ^ t -rtu* s -r c wj £ bmm- 5 r t ^ x* 

h JOB^500^**ttX^St Lfc*^, yy>-^A 
■ef4250»*^9, 7 p y >^BXIi500^^€>t'>a ^ 

[0 15 8] -fZt, ^X5/7"S523X-H 1^5 4^1 
^7^-^X-m^^4xfc5l^ttl»^S:«Sfc-rctis 
X#^l/^X% *7"S527X\ p°pf^f|l:lo^ 

^>-r 0 rex, 05 4<Dmj£'<7*-*xa&'gtt?§ii£ 

^tlX^^^<DX\ fft;^f y7^522(DRlJ8«p B W'>r 3 L 

fcjg*. n a p^^^p a p^(0 i C^oTHJftT^JW 
7^y >^A521X50^h^ , 9, ^i4^fifc-TOX\ 0 d pI 
STfiKftSKft^tt (-1) KIS:£U jEffftT-T*. 
[0159] t>Lp° n ^^2a±l-^UX^fe 

x*#ftv>ox% §ibia:^^7-t^ox^T*r5o 
[oi6 0] Ktt)Hti 8) d5 5it yy y h jo 

Biib^Hp$5180^(D^tt«:^U^7ci-^^- h 
X-fe6o ^y >H JOBeSj*3ESB518X*tt, 
fc**ttftt;tt«rtt*»fi-r5«ffl-C, X#6fcttii5p a p 
KT-Bl*JX-#6J:5l^7^-^«:e«l^3E-r5. -to 
±X\ t^T^^Mt6ri:^t^^t^ ft 

[0161] i56ii, *nmj{mxft\Mt$tiz>7 i J^ 

bJOB<o?ygt, fi!ffl#ds^Ufc/<7 7«-^S:au 
fc®X**>5, ^HJfeJ^ji^ffll^fc^^xAX-ttx 115 6 
^LfcrjiyhjOB©rt$^ ES^<7^-^S:*> 
^-drx^y yh jOBt^x-^6. #HlfiflS!Bt?tt, 

PnmBat h-^-^fflas:^ ? b-r z&iz. ?v 

y h J OBO^SiJa^X^ftST-SOO^i uxi^p^ 
-?:O^X^p p pm(1^5feX'^6t^UX^6o 
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[0 16 2] H5 5fc*3^T* ^y^h JOBili^H 

5^S^r^{:-r6o 0J;itf. lS15 3^^^Lfc:J; 
/JJyM^D^BWpf ( = 1) 

&ffi£l2¥i£l00mg<t200mgT£>6o 

[0 16 3] ^^Tx ^x^^S551T% n°pfffc££$c£ 
p p p^^S (0*x.tf5) T-fcJJDHfcU ^x^^552T-Pn 

y V^B522lienJSiJ^T-fe!9. 7"y^hJOBX^^zL 

- y >^52or^^r^^-/u^ttT^6^y yhjo 
ynoBWoox^^tt-ci^^ufc*^ yy> 

[0 1 6 4] -T6i:, *xy:/S553T-{l. i5 6^ 

0»j£*»fc-*-i0T\ M^^^^^S552(DgIJftiJ^(D^ 

flfcfMK ^Jffi#^^Lfcp p nW (-3) ll/jlot^ 
OTJ^fi^y >-*A521t450fjrC*>!K 3fcfcte*iJifc 
•f-;i£#T*#fci\, ^:t% *7^:/S556T\ p p pIM 

p Q pf^M^jl^7^ 
tls affi$te<&»£\ XxyrS560X\ ^$tlf:fpft 
yy JOB&^HU 3E#»T-r<5. 

[0165] ::t% t>u*^^affi5fefc'ofcfc-r-5 

p p p«ip°pIW 1 C^oX^^t^f^^li 

fcJBMto* (-1) fcffc^U 3E**T1-6. 

[0166] mmmmi 9) @5 7d, ^m^tto 
mmzmi^cisxTMz&tfz, ^y^hjoB^ 

[0167] fcjeu ^H^HiT^ri/^yy y h 

ft, fWJp D pff, TOJ^X^t'OTOJ^(^#3S^ix6^ 
[0 16 8] H5 7I^^T, TVh-r->^5lO 

:/y>MOBffo£toi2-e7 p y vMOB&fl* 
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sl :/y >h jOBit{f^5i4{wj:t). yyvhjOB 

[0 16 9] D— /<^5/V511-e«U il^T#fc7'!J 
V h JOB^^y V h JOB&{f&516{;i<fc^rm 

9. :/y y h jOBj^R^57itcjf-r 0 7*yyhjOB 
m%v$S7\vi*, ^ofc/yyhjoBCti^ 

io *-**jF<Dffi«l-£&*f 5- 7*yy h J OB</)^7 ^ — 

«U tt«f^t^a^ii7*yy h joBSij 
[0170] yv y h joBS»i»:^5i7-ett. ^y 

T^y >-h JOBSib^JE^518X-tt N P3fllfc«yi£ 
-f "OKiRjg $ tit ^ 5 s<7 * - * 6 r £ T* t> % 

20 hjOBit yy y h j oB^v^-y y^sus2o*s 

•^r^jii&yy v h j OB^ftaJsig-tt^ta^tt 
Ts ifcttiaK^y^h joB'ismttteRD, mizti 

[0171] ::t\ yy y h jOBgSjRjtSPRo^y 

yvhJOBi»^3EfB5518^l4, ry>-^^»Sttg|55 

^Sfcfc:/y y*w*x-**asjt!K T'yyhjOB^ 

30 V h J OB^^^-!l y^520^^oT^6^y ^ 
[0 17 2] H5 7^LT*>6 J:5Jw % ^y V 

rf. 7*yyhjoBi:MUc-7^^ ^"D^^f 

[0173] *mmj&BX^ 058 (I^-T J: p (C. 7 

!JyMOB^7^-^«^ g^sfg^lfflu 
tife^^tKlti^, 1113 0(1, a^slglwi: 

^57ir*(i. 7 , !iyhJOBK/<7^-^i:Ul$ 

ixfca&mf§fcj:'&m^£. 01 3 o^ufc&^mis 

ho 

[0 17 4] At>£titc&?mm<P<DX^\ Wijj 
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cat*] \*mm^At>£titz7\) yv jobcdf^ 

^&$*t6. ZZX\ x^n r»§l5tffli«c. ^ 

^-fflsttj wwr-*-*** f^p^o [p°p^] x- 

m lft£TOJU Cp°p^) X 5&£EP 

[0175] ry^hjoBgfiiia^si 

[0176] [Hlfe^«2 0] ^HWfiXfi, 059 
y°V yb J OB<D/<y *-9<nWCfe%, 
y°vyb j OB<Dft®vhZX&&m^1fc£titcmjfi 
%kfrm^^xfT^x^z> 0 ^!)yhJOB» 
571XH, yyyhJOBOrt^lSRU, 

KftfE-rs, 7^-> 3 yn rax&5 0 r^i^j 
* hjtt, r^>/<-ffljxM, pW^H^l 

X, tt&l*5tfc£1-<5 (fllffl^ttABC^n^* h<7)- 
MXfe5<tl/^m^iTOi^oX^6 e ) . 20 

[oi7 7] rticifto, > b j oBsmmfe&si 

7, Rt/^y^h J 9Bi»2E3!Sn518£ilPlOto31ttx n 
[0178] (HffiJ&jg 21] ® 6 0 Ji % *nmj&M<D 

*u ^t>^ofaoif^(7)^^^u/clix$>5o ft**. 

[0179] fc/cu ^nis^iiT-ai^T^s^y > h 
bums*. Bnid*>fXfe^opn#»»c#BR$*t6^ 

[0 1 8 0] 06 Olwio^X, fy^Ty h-^->V510 

■eji, ^y>h joBf«^5i2xry>h joB^ft 

fifeU Xy^h JOBSB»SiS513|C^ofcAyfElSLfc 

^y >-h J OBiiff gP514^ J: 19, yy^hJOB 
^^Lfc^7^T^h^W510^e). :/yy*£t 40 

[o i 8 i] if— /<-7->y5iixtt, i^^^txt/c^y 
y h j ob%7°v y h joB£inU5mz£v§Lim 
5, :/y >h joB»i?S557i^irr 0 yy^hjoB 

Wf?«57i-cfi, ^itiofc/yyHOBI:^^ 
^-^^«at^si-r5 0 ynyhjoB^y^- 

*SaMstS:£<04§£tt:/y V h J OB eftfiS:£gl55m:: 

ttu -rxjc^^ttx^e^fi^y y h joBgi 

^jEa55l8lCjS1-. *fc, /yyhJOB^;U-> so 
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3>Sj5601Xli, ^y>h JOBT^3t$^fcSS:SXO 
BJJMfcv'a. ;U-hU m\m$RXfi h^HsEffiSSr* 

[0182] yy y h j obs®j^^517x^ :/y 

T^y y h jOB&ft«3ESB5i8-e*i, l*i&ft«yi£ 
1-Xi^S^^X^5^7 sr^M-f * r t x~i>m 
m-T6c ^0J:^(CUX, 8a^*fcttSE3E$ixfc^y y 
hjoBii ^yyhjoB^y^-yy^520^ 

X. Sfcttg^y V hj OBiHfSSS5519^atU. BUM 

[0183] ::t\ ^y^h joBi»ta:^5i7R 
t*/y y h joBe»^35Si55i8iwtt, yyytfttitm 
ffi,i$s\s*fr\,xm§t!titi3\m*. IE®, mwkm\^m 
<o^m^m^y x ) y*<o*y— ^yybj 

IC^y y h JOB7^-!i y^520^^oXl^ 

xy y h joB<DTOx^^^-/u^ai!9. mmzti 

[oi84] 06 o«cffLT*>5J:9iw. yyy 

ff N T'yyhjOBtMLfc^^L ^yy^^f 
suxv^^^y^i^c^{c(i. yyyhjoBlfi 

[0185] 0 6 lfi, /liyhJOB^a; U-y 3 

y^m{z£z>%m<nyv--3-^-bxhZ> 0 yyvh 
JOB->i^—>3ySli601ftt, ^-fxxyys6ii 
X% f~ x h^ipiii: LX N MOTPr^ h-^-^ffl 
i:^^5^S^^b"r5 0 Xx^^S612X% ^y 

y h j oBx^s^^fc^xoTOjflf^^^^ $ i/- 

hU ^X5/^S613X\ ^y >h JOBX^^^tLfcR 
[0186] *#«|<C*ttf4 % Hlfe^tt 17M18T' 

[0187] [Mfawmz 2) *jafi^iB-ett % yyy 

[0 18 8] 0 6 2ii N #£MMWi<D7'y y^^fA 
JiT'y V h JOB^r^fl-r^i:, ttlfeO^y^hJOB 

0 6 2^«yi^je«ii-5. 

[0189] 06 3i;, *nmmm<o'7 i jyfii'XTJ* 

y>*63K 632*1, ^I^K^ffl^ ^y>-^63 
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xn, &mmmz¥<Dmt) v^^\m<D%m^h^>t^ 

[0191] 06 2t^^T. Xx^7^621T\ ;/y ^ 

J O B (DftgtplztZAiStltc&mZMMi-Z Z £ T'&ft 
Em a i 1 <D£ ? izmjlfrb 7 V > h J O B<D 

XllZ, FAX^Ema i 1 <D\X VtDXylZ UTi^ffl-f" 20 

^^-f6 0 *X:y:/S623X% &tt9G<DA^Xmfcm 
b^ZtZmftTZo *^;y:/S624X\ yy^hjoB 

iea s ^/c^^«R*r e ^ <t xm%-rz> t\ 

Ema i l <DX O^^M^h^ 1 ) > h J OBO^tll 
llicfca^ ^^^^ffl^fc^xAcoj; f 

^S626r\ ^i-^^^^nr^^^^ii^3fei^^ 

1&LX, tht) h l~f £if§^-f6 0 *Ty7S>tnX\ 0 6 

^4 m^hhfrzm\m%*wcfe{,xihti\t. 

fflott}^ h w left d , #(^^ Lxtsfrbtttitfzti 

[0 19 2] *x>;/:/S628X\ £PftiJ£HfT-f<5o *r jx 
7*S629X\ B)W«TU iSSft5c^«a«H^«>5*^ 

^xy^S630T\ i£tt7tK^JW&TL/c: so 
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CirfcilfcrtSo ^xs/^S631T% -^Fp^S^jSo 

x^x&tfKfc%mmm\z.hz>^x.v?~rz>o ^> 

7"S632X\ afeW5EK:a»!l«*S:#dS»^ia»oTt^5i 
[0193] [%ffi?gj£ 2 3 3 *JOteHB-Cfi, 

[0194] 0 6 4 ii % *mmBm<o±m}temm<Dffi 

[0 19 5] XT?yS640X\ &m*t><DAJ]tfhZ>fr 

\^m^m^SiLx^^j:i^^mm^s 

it, *=ry ^5645X^—9-*^^ L XPo^t \ 

643I^M6o ^^^tt^ff, ^xy^S646(wiitf e * 
/c. ^ryyS640T*A^^^tm^ ^x^^S642T% 
^ff-t-^^ft^^EottfcHUT. ^x^Vs646tc:iitf 0 
[0 19 6] Xxj/^S646T^ ^7^-X^653^ 

xyyS647T*«, ^^^^^^Ofcfe^H^fffll^ 

^r^-<-X656(r^LX^X y^S646fcMSc 
^/jMttttfs ^xy7 P S649X\ ^fTlfP654iCj;«9^7^ 

^^S650X% uxjKy^^HfTSri-^d^^J^U f 

x\ ^^nfc^lc^-fS i/^^yx^Mlta 
[01973 mmms2n, tiititm^ 

Wx.tf*-2K- KA^J. m-pAfl. Email, FAX, ^» 
^If^t'l^UX, ^KZ/^eKtrfT/itofci-e, ft 

<DXh& 0 

[0 19 81,06 7*4. m^^"/^^^^v ? ^-/Uit 

7\ZfoZ£?\Z^ Zma[\X^^>tcX^CO^m 
*«WfU T2^220j ri3B#30^J Ti5:0 

oj t^p^wni^ao^aiLTiswu r^om^ 

ldBg:b!9<D£>6;£^ r2^220(7)130#3 0^»?> 1 
5 : 0 0£TB£S£gX\ #fF->^xA|ft^^$r^L 
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[oi9 9] tit. mm^tz.nf^^tmmnt 
/mc^&u m^mn^m-r^mxhti^ 

[0200] £/c, mmm52te, K&frbAJiztitc 

^tf*-#-KA;^ ^A*K EmaiK FAX. io 
[0 2 0 1] ^W<Jtw»i x #J;tff, XYZt^^^j! 

i/ ^ Kaffir # itm k x y z £ ^ 3 (pi^^#^-r 6 r t 
YZfig^j ^<t't^ofc^^^-r6r t-c% xy 20 
[0202] ^^yco^tt, aftro^^vtis* 

[0 2 0 3] v/^^A^ff/^ofcff^y^y^ 

[0 2 0 4] JEJLb^J:^ C^^xA-Cfi, 31^^ 
652T\ ^»*»?>A**^fc»«Ort*«)iWf«:ff4 

7^4T6 e -t LT X HfT&654T\ &S<D||fT£fT 

[0 2 0 5] Witf, H6 7l;ifc6J:5ftEmail£gif 

©•At*-*'*--*!::^*?-*. «iEJWfcffiA 

^-^-<-x^a»^A«5icB8-r«6f»^5fc5»^ic 
[0206] *tz*-/\'frmi&<o%ftxhz>ztzm 
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if, z<dt— ^fciiang^rf Me 
[0 2 0 7] C<7)<fc9f-, *->^rAit £&ofcif$ft 

[0 2 0 8] ±SBKWr-|4x Email ^oT^fc 

kmmi-tctcibtftfjivtcftmxhz. zzx\ matf 
ft±ixx-—?\mmz?rte?teb\ mM&izfocxft 

[0 2 0 9] &l£Wm\z±Z^--?frt>(Dfc7rit 

mmz s *-—D : frb<n&t&wmA?)\ztti,x, *w=>. 

[ o 2 1 o ] w *. tf , r fc-^ix(7)mis#^tt<6r# ? j 

r*-fc*&fTfcofc*K r i 6 0©#aii^t*5 
?j ^e^lrST^^ftect^J:?)^^^-^ 

[0211] n 6 6 *mi&mM<n±fc&te&&zft 

[0 2 1 2] ATJk UCfi, *-#-K*>bA*Ufc 
A^r-v^^lJ^t LTA^^tL^^C^ilJ^ 

i^sfg^A^tt^^#5^^^x*#5o 
[0 2 13] A^i-i3^T. Ai]it (Idle) (4. 0 6 

[0 2 14] ^/c, tiMkLXft, xlri?=.—A't£l?<D 
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***neftjfti"C*>6. 

[0 2 15] Affi7J<£>*g^t LTIi, a— tWf- 

[0 2i6] *fc. AotifcmiWfur, AfcH 
■reft^^^irii-reff^Srx-^wtiiLT, $a 

m $x - * X ^ a-Zl^f- * kiwai-* £ & 

[0 2 17] me 7©Wm AoTtfc Email 

fcflWLfcilsTII* Ai-BB-t-efEj^fctT, 
To : toshimaGabc. canon, co. jp, 

rohraBabc. canon, co. jp, 

kazuyoflabc. canon, co.jp 

From: icblro6abc.canon.co.jp 

(ichiro@abc.canon.co.jp) 
044-549-6312 ( 620-5151 ) 

Canon (») jnftWffi^^^^AtoiWftitBl 
* J ffiU*5^ ;OH^-^7K^" kazuyo@a 
be . canon .co.jp" T*£> 6 A$J # 6 Af - 9 ^~ * 

W«t9C> PERS0Ml.2.3Wif|RAS4Aai$ix. x-*^- 
*65l|;i^£*l6o 

[0218] i*wt]ai-5f»«<oaffifi t ur, 

r 2^Z2P^13l^30^?>15:00*-CB#aist"C, WFS" 

^xAifc^&^L-o^-r. j ^^-re^-e, * 

[0 2 19] Zbl^ Wfc$frZ>T9>SBl'*mfc*Z> 

[0220] 1168(1. i6 7 43 J: #0 6 9<0#yi£H 
5c^K*»d«rft#fflL, l£fT*ra*X5/:7S649&J: 
[0 2 2 1 ] £JLTI-^*Wi-ia6 7, 6 S^jflctU^fr 
[0 2 2 2] ^X'^ 7^680-0, Emai l<7)A;W&£ £ , 

yxmzffir-fZo ^yysmx\ 

[0 2 2 3] *x*:/S684T\ A<&fMS£ttliJU x- 
^a-yK^t6y7y^fcT6o ^xy 7^685^ 
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%fty*y xx^^s686x% raa*s/ii>«) 

T\ *xyyS688~*yi£&1% 7^688-0, A<£> 

m&£t*ajLx-*^-*l::g»U ^ry^S685{ip 

[0 2 2 4] 067 <D©£\ Xf y ^S685X\ Ifc^-f 

*xy:/S688T\ *^v ? 3.—/i'<oS&£frft5o *x* 
10 7SGBS\zmZk* HfT^7>-tt*<, *x;y 7^689 T*il 

[0 2 2 5] B6 90«^, Xx;y:7S685T\ Ift^-f 

^hbx^iS^-Mz&mTZk^imftyyy&ft 

5 0 7y><Dm?r\a*?$mfchZ><DX\ *xy 7^5687 

Iw^t v^i:TiE-ro ^X^^S685T% «£#^Ti£ 
inTZ>yy>&&{£-tZ>o ^xy7 p S686-e, ~fy^<D% 

ft\z.mm&m^<nx\ ^xs/^s688x% a^js^©*) 

6, ^x^yS685-C% J-— tfii^PfflO^^T'x^ 
tftttho Xxy7 p S686T-HfTtJ:BaStt«<, ^777* 
S688T\ EmlI©rt**5J:O t ^^a-/l'«S5t!:±!J, 

£g£{fr&-f6o Xxy:XS685T\ HfTT^ttft^ 

[0 2 2 6] H6 9<D#J-m. x-^ttm^tWc^Xv 5 
^-/u{f^ EVENT l amfTJ^^^^tbT^/t^x^ 
30 EVENT24rJteLfc^, f^Mot^6: 

kfrftfrZ> 0 MK, IS 6 9«>«-cattlLfc»WcJ:*t 

tf * fite#ilt ^tt&jfe Lft Itfttf ft & ft £ * t> 

^(D^^jfflUT. x^SftoT^S&^filCft 
«T-#fti>i:i^i , Srfi^6^3RS:^U i»lWI-jg 

[0 2 2 7] ^IWiV^c^fA^gi 
40 [0 2 2 8] (Xffi^C 24) 

mxhi> a 

[0 2 2 9] mmm* w&<D£mni?z.v*z>Astzo 

50 -V^Lfc±T\ »h-^MU ^7X^77/^ 
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[0 2 3 0] mi 1(4, m 7 0<Dtm<Dffiln%®6 4<D 
|*7o-ft" M-S^X^fcLfc^P-^- h 
Xfc<5 e ^rtll ^tt^&^A^^Kisi^/^oTV^ 

[0231] naaowra^-rstoasriftw-r*. * 

■C^S^cott?) *t^S7UX\ A 

*X**Wrr6o *t*:/S712X\ W0^»^-T5 

*xy:/S713X% WF^gxS/c 

[0 2 3 2] Xxy:/S714X\ ^^fl|f$R(W£(2 
&^(7)X*x;y:/S7l6{;^S£?&^;6>. ^tri/^—Mz. 

16X\ ^t 1 s/7 P S713"Ciz:"Cfc7 P 7 i^^fr a— tf^ 

[0 2 3 3] £CX\ -£ftWtt»Tl-5*J, icttT^- 
-^t>W»Ba^A^J$n6 0 2(«]@(DMPn t !{^-r5^ 

[0 2 3 4] Xx>y:/S7l0X\ ft-m^O^A*} (T 30 

X\ A*:fc£AWrfS. *XS/:/S7l2X\ llHlgOOT 

[0 2 3 5] Xx^yS7l3T% J£Jt 

z^t &fy ® utefciKKSfc ux»E-r s r * £ 

fy >\ ® lir-^^-^ti^f-^^-^^ 
^^^U^^^#-r6^7>-, ® iiiteK^fr-frfc:*: 
^Zi / fj&-t67'y> 0 40 

[0 2 3 6] 7fy^714tft »««>=ffif4*lf\ * 

•f*<&x\ jg**tr*5 w^fttta. A*J 

xy^S718X\ ^-inciifcrt"*. £A-tX\ I70O- 

[0237] mimm 25} 072 towa. so 
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[0 2 3 8] wO0?O^IC(4 N -#<D^j£# 

[0 2 3 9] «ifc#U fiJffl#»±^rir^fe^«:SIS$ 

X\ ->*^Att % ZtllZhtritlZTti/als&lifcff? 
C£#X#6o r^Bf. ftSfciS**^:/^^ 
£0^X^1*5 C£t>X-# -5, 
[0240] 072 (4, 06 8 07P-ft- hXfft^ 
LfcAr y:/S686X% x^r^a— /KOif^SrlSEUfc* 
-£O06 4<7)Xxs/7'S646T-0^7^S:T^C«flfi 1 ^) 

[ 0 2 4 1 ] 06 8 T-te, ^iP'&Ojg^^^^f^lw+B^ 
UTlftWLfc*«, ^^X(i^x^yS6 
46(^> y fy >—>y<0&!i5!£.jjfeb LX, Hic^y^y^ 

[0 2 4 2] 07 3te, *y'"y=L->vm$m<»V7 a y4 
[0 2 4 3] ±faX^-<fc^^v ; ^-/KD@^tt, X 

x ?ftAmztt\*x&feLxis^xii&\<\ 

[0 2 4 4] ^fc, X^v ? ^.-/K7)g^)^ib^:^^4 u t5 

tt$l«Lt^^, *»M8jgflM''<y hit) 

[0 2 4 5] 

[0 2 4 6] |7 3l:^^t, Ar^^S730X\ gE#^» 
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T\ ffitt&<0«9c&<Dlt&ZfttZ? 0 *xy:/S733T\ 
xnm^y^-^f-tZtM^ 06 8<DM^-V 7*7 v 

~>?tmm<Dmm%ftte? (074) 0 10 
[02 4 7] 0 7 4 f*, _h$<z> y ^7 y^yytotismo 

10 2 4 8] *rs/:/S740TN 12 7 3 -C**W«||C»fc3g 
*£Art*-r*. ^xyyS741T\ Art:»£aWr?- 

60 (d)^— Wzmto-tZX^bftlfctZo (e)I^L 20 
[0 2 5 0] Xrs/^t'll 7.7 i .yyS743T^r/c 

aoAiwii*B-r5fc«)<03:#*f^L, ii*q-f5 0 " (c) 

[0 2 5 1] ^x^yS745T^i, 3-— tf*— OiifcdCfcJ. 
— F^fi*.*. £JL±T\ 117 2<D9im&nfti-&fcl!><D 

[0 2 5 2] CHJg^tB 26] E| 7 5 fl, 

£ 0 07 6te, 0 7 SW^^rA^w^yiOjffitL*^ 

[0 2 5 3] Email, *p s KA*K WWW, 

FAX, **-*7\ ;M7$€4lA;M£3&a^A 
7J £*t/c{f -f^T A^Management&575lXj&# £ 
tl(*T y:/S760), Core^752T\ ft££3l«U BH8 
^^S^^>^y^L^m(^^yyS76l), fl^Mana 
gement$|J753tCj:!3, tfj7Jp< x 7£:$:£ L, ffiTJf*]^ 40 
^tH^^COM^U^^(^X^^S762), EmaiK # 
7^, WWW, rlH£\ FAX, 7})y# x 3fcT-ffi|^#S 

[0254] 0 7 7~7 9tt, 0 7 6^7n-ft 
-hO^ry/T^^fy 7^5760 (A73 Management 
ffl5\<Dtm), *T*;/S76l(Core^7520ftyS), *X 
7^762 (aj^Management$i5753W«M)«:^*6<j|^*> 

[0 2 5 5] 0 7 7{Uo^T, A^Management^75l 
li, ^xyyS770T\ mfaAJ)*mo 9 XTy7$71\X so 
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A^^tufcm^^^it-r^p *-ry^s772-m, m§L 

fcA*»ao«W^*^5*f>a»«:fT^ofc±-C|| 
fTi"6 0 CO03\ A?jManagement:g|$75lfi, H^t^x 

[0 2 5 6] 078 {Cfcl^T, Coregfi752fi, 0 7 7 T* 
#tlf S Jh^ArtiMRSrSft 9 teg**?/* 3 o 

[0 2 5 7] Xtv7S7WX\ mm&%frbAtitim<D 
@&wg# ('^7A, 3.-^) ^^i^^r^ux 

^5jMW'<6. *X;y^S782T\ S^Wti^i 

?c ^X2/yS783T-Ji, X7 L ^yS782T*^«bn/c7 P 7^ 

[0 2 5 8] 079 (Cfc^T, m^Management^753 
ft, 07 8X~nft\^tc1£&frhyx#>XTZ&mtfjb 

[0 2 5 9] X 7^:7*5790X1*, 0 7 8 T*HfTLfc*g* 
©IWf*:^*5, *xy:/S791XI;£, HfTUfc^iw^ 

2/7"S792X\ ^^ibou^/K^^-rai^^^x^ 

!:^J:9twt5«^t6 0 *x y ;/S793X|}, 
#V*£^#?^7^T£&£-f5 < , ^r-y^S794"CI± 

5 0 ^7 l 5'^S795-e^Ufc^^#^^S:^'r^ri^ 
b^rT^fT-r^o ^x^yS796T% £Hf^[i: 

[0 2 6 0] #J;ttf, 3— lf^#S|OMffiS:*Rf>-fr5E 
ma i *-fx A^Manageoient«575l 

*-J:«3. 07 7^jer*A*ff««:«Wff6. 

CoregI5752|rJ: ^ , 0 7 8^1^, ^-f-'&tf 

$tb6, J±J^Managementgfl753l;i^£tl, 
07 9<D^«iT-^a^fftott, l/X^>^-f-<#^^y 

[0 2 6 1] ::t\ Email X'$Ht>$tltz&&<Dift 
®^frmti<0^-^(D*^i>^~;\'<D^m^£.'iX 

&mt£ky e 7y~yt r £tiz><nx\ isxtfyx&&Et 
/jr-5o J:oT, *y7s79\xi>x#>xh*) kWftts 

tlZ> 0 Xx^^s792T^i, U^7Kv^1-6rt^s^$ 

<o\sxtfyxT*ft&$mizzxikfe£tiz. 

X, Xx?/^s793^4o^T, ±IET-^$jxfcU^7Kv 
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5 ^ <t rtmtRZti. y ^ 

[0 2 6 2] [3 8 Oil, |3 7 SfD&fc&oMtlZZblzm 

[0 2 6 3] ^»^^ffiV^fc^/^7 L ATfi. 
A*£ft7c^a\ £1\ Xt^:/S801T\ ^ T 

ocr ^MoTii^ yzmfei-z> 0 20 

[0 2 6 4] ^r-y^S803"Ctl. OCR(Cj:<9 N J£$J£ 

(omm zm-tx^n z tix ^ * « km t* &*l # , 

[0 2 6 5] ^T!xyS806Ttt, ±IMfS£*L/L;£#* 
^T'^SK^-^^ffl^-Cx OCRia^fyn^^ 

mt M&-tZ#mm&\z.fttE 5 S> * & 

L> #^EU7t^Xx^7"S808^ii^ ^EU^ofc 

[0266] xT-y-Tssosvn. ±Eai#£*LfcifciH.£ 40 

Tele, »i jFf^P) I *x 

[0 2 6 7] Xx^^S811T'(i, J:fET-a»$tlfcBW 

[0 2 6 8] ±ie«tm<i:tK rt«4r*ftMU**se>OC 
R£fr?C<t^-e#6<7)T\ 5la^#ft!?££ 
fcOCR£fT5 SM*J:< jE»*OCRa*4:» 50 
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[0 2 6 9] H8itt. T-ftoto&mntt&ttett 
[0270] ztotoizts^x* x^y-TsmVs £#0 

IsJT*} bfrt>XW<D*j7>*mm-tZ>* *<D&%. Do 
cTypel =^/f ax . < h^6o 

[0271] *rjy:/S803-c, ocrkiJ: 9, ^ 

f/Py^^iWD, (138 2 #10 

From, To, Dear Sir& JftfftfetU *xy:/S804 
T\ DocType2=^|ft/faxfc{i5g$*l6 q 
[0 2 7 2] @8OW*rs>:/S8O3Tift0!Lfc. OCR 
t^J:^^oy^^»!J*A«€|twgftW-r-5. 138 

[0 2 7 3] **«S^*ffl^fc^^At?fi, TIE <7) 

At, DB823fcIf;lTfc 

C^Jxtf. 13 8 2<D#- K±<0#rt<&&#)<Dttra£lt£ 
®±iBT^ii**Lfc«I««it«:OCR<?5W*t UtM 

[0274] jgtc row-cat, J*<D%-V 
[0 2 7 5] ctucj;^ «iaas^>c«4rp)±tx ^¥ 

[0 2 7 6] (3 8 0 0^x^7^5808X^0^ Ufc, 

[0 2 7 7] *||JS^I8S:ffli^>'^rixT*tt, 0f^o 

t-^«:#bsu-c, 138 3 o^niicj; <o % mm<Dmm& 

[0 2 7 8] ^#6<J{ctt N 08 1©it^iat, Da 
telSrAfir<O0(t, Date2S:^0©0f+t Lfc^r, 



43 



(23) 



®ffl¥- 10-240552 

44 



(D Datel = 1996^11^25 0 & Date2 = 
© Datel = 1996^11^25 0 & Date2 = 
® Datel = 1995^11^25 0 & Date2 = 
*#0tt 

[0 2 7 9] 18 311 AXZfnltXmfrhBto&fflr 

^Xfca^J$r£tl, *xy:/s831X\ -fcftKfctt&LT 

ft, ^T-T5 0 
[0 2 8 0] i^I#^^"lf(7)^^(±, 

*=r y 75832^1-^0 ^=r y 7*s833X£S^ 0 ft t 
$B<DBm*tt&£ti. 0tt#»v|§<£im 775// 
s835X, ^m^(DXm^miB^tc^t f Of)^^^y^ 

ttj £*ft£$*t5o Sfc, glffi&SA Lfc»<0»A 
Kfi, *T*:/s843X, W^U77-fyy^ 

s^i^^g^^^aj^^^o 20 

[0 2 8 1] X#«)Bf+36S^9^ot(o-cfc 

s843t^5iif 0 iillLT^/i^o^Cli, Xr^7's8 
371^ if*, XSr ^ Wit 5> ft&l- 0 f*#fE«fc £ tlX\f 

X7 L ^^s843^iitf 0 B^I^CIi, @^)tlt 
[0 2 8 2] X»<O0ff*S3WE<OBttJ:9^3fc!:) 30 

s839lwiil> 0 

[0 2 8 3] (»|2 7) 0 8 4*1, ^Hlfe^ffi* 
[0 2 8 4] L**U *»l^->xfAt:j:nH 

[0 2 8 5] CtU^Jz*), FAX, Ema i 

[0286] mmm2s) 08 5*1, ^mmmm^ 

[0 2 8 7]o$^ Se*&* ftfcfcgOflgfcfc C so 



1996^11^25 0 - XmmZ> 
1997^7^2 0 - 77-f^ 
1996^11^26 0 

= 1996^12^ 180, 220 - ffliS^ 

x, 77^!)^, ^^-y^ 

[0 2 8 8] (IW2 9) 08 611, i8 5t« 
6Kg-3^X, H8 7<Z)7P-ft-hi:^oT, 

[0289] H87it *nmftm<D&m^m$:mt>-r 

7n-fir-ht^ 0 0 8 8, 08 9 ft, Z<D^m^ 

#/< — :-^^$tifc^o*nStt-t--^^K^ife 
"b^tfc^WT'fc^, *H»^X(1, 08 8, 08 9 

-f£Role£, &mi~Zffin&$LJ£-r ZCond\t\onXtt, 
*&^3*lfcteJIAction*fc#U AWf£?T5, 
[0 2 9 0] 08 7l:^t, Xx^yS870T*, 

S871X, 0 8 80ft^-*£#£BL, i£<f^\ £if# 

ry7 e S872X, tatH Ifc^f-^^-^CIit 

60 0*;itf. 08 6(0#jXll£{f Lfc£#0;*7/< 

vt^rTo: Macrohard Corp. J t 1^5 l£3WS<a £tlXl^ 

6 0 %zx\ m 8<oxtt\<Dmizfe&tstix\t>ziZR 

X TMacrohard Corp. J ;&Sffc£ti£;ft,6 0 
[0 2 9 1] ^xyyS873T\ 0 8 9 CD*'*—'*— 

PJx-tf, 08 6(DMxn%mLtc3:&<D*s< — : 

— v^t^rFi le: HH/ContractJ hli^X^W^titlX^ 
60 *CX\ ®8 9<DX^m<Dm\Z'£&£tlX^Z1%B 

77-f y >ymm<D\nwLt ux, ^mh 

/Contract J ^ttttS^tt-5« 

[0 2 9 2] rCX, Datel = 1996^11^250 & Date 
2 = 1996^11^250X^6 t't^t. H8 3Ho^ 

uc&oi^ m-xmmztnm£t%z> Q 

[0 2 9 3] 7.x^^S874X(l, &%m<D g m<Dtc$><D 
V^#S-r $f)^mi- 5o ^ y yS875Xtf, 

^V3^^fT-T6 0 Xr^7 P S876X, ' <-e^o 
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^mX'hh TMH/Contractj \Z.~7 T 4 V y?TZ> a 

^pxteim^mft-rz* *T>y7smx\ *<n{&<DT 
v- Yfefefthz><DX\ ABct^o^-v-vx-iy 

[0 2 9 5] (»13 0) HI 9 0(1 li^iCfT^tl 
T#0SLT, &Q&nfr-tZ>MZ7F'tmxhZ> 0 0 9 0 

[0 2 9 61 191H *nmmmnt&m<Dmtiz^-r 

Contract again to John. Notify him by Phone, j tl^ 

X g (ft t . rCont ract t ^ 5 £#£John 

UFAXT'SiillL, §iJi#£mt£-e&lib-£6 0 J 
^ir^S^-TS. *rCT% ^^(^^Contractt, i£ 
{f5feJohn^^LT, ^S^^tT^^^^^^ 139 

[0 2 9 7] X^ry7>s9\0X\ ft^mt ^ b ^ t teUffi 

\zm\mmt>tixi^(DX\ 'f-t^-^fabmmmwL 

^W#-T6o ;£§Contract&UUohn#/i^ff 

mfrb¥fi££tiz>o *Tyysmx\ /<— y-jvur— * 

s<~~*frh John <DfcfcZm%TZ>o -r-^-*^ 
II John SmithtJohn Bush 1 1/^ 2A<£>John^#£ LT 

£T\ WBUfC^Contract^iiofcJohn^fl John Smi 

xhXhbkWJW^ &iaftfr&'fet5]nZo *t*:/S912 

T\ 77^y^f-^^-^*^ TContractj 
^#t~6o ^xy^SgiST-, i^fI5feT-fc6 John ^^C# 
£i§{rf<5o ^x^^S914T-^ il^TF TNotify him 
by Phonej fth%<DX&ft<D>&mt l foZ> t n^h* 
Xxi/yS915T^i. Hj8 9<t^, 

[0 2 9 8] Efc, £^££{lLfcFAX90lfl fft$ 
Oii&Jt^ lf:^ot, John^Mr.Doors^ib^^^S: 
If L/c^t^. miST'ii^-r6o fcfc* FAX90!^m 

[0 2 9 9] (SlJfi^ffi 31] El 9 5 (1 »/r£ft/cA 
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/:^7P-ft-hT'fc6 B (§19 2(1, A;«#<0£ij 
^F f 9^^^t?U/'clir*$)6 0 0 9 4(1 119 

hm&^xi/*Tj±mm^tcmt>xwxh*> 0 

[0 3 0 0] H)9 5(7)^D~^-r- M^g^T, 139 

2 ^A^^^^ia 9 4 <Dftt)xmz{m-rzi£x<D® : 

[0 3 0 1 ] XTy7S950X\ H9 2(^AMM» 
tt, J^TOg^^^?-T6o (a) John Smith 
io RZSB<D3mzmmm%~rZZto CO John Smith $ 
A/tt 0 *3§# (c) SRl-a? x. fc*-c& L^C 

to 

[0 3 0 2] Xx^^S951T% 3l#Utrt&J&*<b* 
#*W»«rtT*5^tA*«:*]Wr-r5, CCtU IRC:® 
jtfcfrfrfctttLtf <b ^ £ JpJ^ri- 5 <0 T\ Xfy :/S9 

XS<05S3fe?5*e> Aruna Rohra ^^t^itfcS; 
<b^M^tb500T\ ^x^7 P S954^#6 0 
[0 3 0 3] ^x^^ > S954T\ (Aruna Rohra $ 

^Jffl#iCjohn$^^ai^tcfT?i^^tttt^<b^V^^ x if 
^S955T% ffi\<^iiit1z1&&frbfr\z®%fttj:ifr&n 

zt£^fa$:Mts'&mt&x%tc<Dx\ ftmzmz'r&m 

frfoZtmmi-Z> 9 XTy7S95ev* ffl^^A/l-f^Si^ 

H John§^280^SI#"f5i:^5fflf«4:, 

fc ^ o fc ah y ^ ^yK03t» «: *f+i" 5 1 1/ ^ r $> , 
40 XSSrg«i^UT^5 9 

[0304] &±x\ Afixm^b, mm%&9miz.tt 

[0 3 0 5] »13 2) m 9 6(1 y^n^t^J; 

[0 3 0 6] xnmm^^xTMzxti^ r'U* 
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[0 3 0 7] o^«9, ov^^^zmm&m^fart 

TK^^y^^WU* ^-f if (^)U I 
1--5£tt-Cfc<, ©^ftloSCT^IftU I **£f 

[0 3 0 8] IU9 y^ V960£F AX963(^ft 

H-$rtr% FAX963^f>ttfeffiSfiH5iJft««r#T. ^ 

toJICjj^tfCx ^$/f^OT\ rFax to JohnJ t ^ 9 X 20 
^J£A7JLTFAX963i;i^-f 6^ £ T\ ^y^V9 

-t(7?S^*tU-C. FAX963^-t^ h ZtltzX^ 
[0 3 0 9] CHJ6JgfS3 3] 09 7(1 xf-^^e 

[0310] *nmm<Di'*Tj»\z£ti\'£, 

■C#5, 30 

[0 3 11] ^rftl^J;^ ©y^e-h & wf 

Sr^TflllcU ©-^ftft^n h3/^ffli^CK*M 
[0312] [29 *x-*;**=.*970£:/y 

^^96K 3f-»962, *>-5l^tFAX963^[p]tfCx 

* yf^y-C, rstatusj £ ^ 5 ;£^j£A7J UT^-f 

^X-^^^^x-^^^e=:^970tC^tbLT, 
^y 1 — ^^^e — ^970^^-— f-'^^-x/<^ ^ 

* £51181-* ifctf "CSS. #j;Ltf. ^yn^96 
4*5, XT-* X^-fWQfrbWtit^tf&iEXZfa^ so 
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# LTi§{§*IIEft:/ y >#9Q\%£[Zttl,Xs '* V = ^964 
-^t7°y >-*96l£^LT. ^yny964^io*7 L -* 

[0 3 13] (HlfiJgt|B3 4) ®9 8tt, y^-^>-960 

m*bmfrmLx&7Fi-z>w&iF-t®xhz>, mimm 
Kfatfx^^^ftWixn y t^cti 0^^^ <t 5 

[0 3 14] rCT% 

©Ru^iiM^t^TO*^. ®xtt&mm 
fciz^- fermx v **>\zmtcm^$:&Lx^z>£ 
sm-mtf* mwhzkzf&xzz. feat mi, n&m 
m& fc (ito^^Mi^ iot y -a ^QGo&tt&wmt 
fatfbtix^zzt*. v**ymot*mmmk(DtiL 
wmm*bfe&-tz>±o\z^xt>±\;\ ®t\ y 

[0315] ommm> v ww&M&mmzfort 

® y ^ v960*^*rft«fllSttSiH9^3l*«-§-S:»*« 

® y v96od^o*r*«isafflijfa^®*ff 

®^iiasRs«jfg^*sit»ofc y v96o«, 
^-r*f*»flii-*)^*ru 1 *:*3eu y ^3^960 

gij«#tt«wfct ufc#, m®&k'fz>zhx\ F\mn 

[0316] ^9911 ^^^tiimi, 

Mf&tau 1 &v*^wm<nftm^WifrftLxm7F 

[0 3 1 7] Xt^T'SQQIX, ?l]ffl#^ffi^tfe^4>5 

msijtt ux t & ^> ^*ttHn»jflr^« 

#^IW»©*«fe-C»fll+5 0 ^x^^S993 
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[0 3 1 8] mi 0 0fi N y^ = ^960*s#feflflffl&B 
ttU #lfc^6UI £y* = V960*)rt&J&*&&*tilL 

6o 

[0 3 1 9] ^xy7^1001T\ y*3>960A*P,Og* 10 
{0 3 2 0] tfgffi&tB 35] H101I±, y *3 

6 C tt&mm\zfattx^ti:\,^mx<D»*=>$$o\z 
[0 3 2 i] y*3y^ii^F^3^ 

[0 3 2 2] fcfc, Tf5<^lftW-e@A^@tt^f[Ot>^ 20 

[0323] ®mm%& y ^eo^^^i^^tt 

r-u i mma^-zmzx? \z.wcfe£tix^z> 0 
® y * a ^960^ <b u i £*ft*fr*r*na£i£*. 

® y -=e =1^960^ ib r S*«*^K3ftl!:tto-c, u 

(§)U I ^^Jt^ofcy ^-ri>960fi, U I ^»t6 0 

[0324] m i o 2d. y ^ = >96oas*t&ra«a*$> 

[0 3 2 5] ^r^7 P Sl021T\ fi|fflf(D»pi$) 
6*T-^«*t-6o ^y^K^X, #ftffllA>feUI 

<Djjfexmt-tt>o ^X^^S1023T% *f*«fll^P>U so 



I ftmtZtlZ^X'&m-t *X^:/S1024T\ git 

[o 3 2 6] mi o 3tt. y^^ymM^ui 

[0 3 2 7] ^X^^S1031T% y* = >960A»?)<O3l* 

[0 3 2 8] CH%^flg 36] H104I1 £-7^ * 
OU I HlHL ANf" — /M041f*)(c£> *K y^-^^960 

Sr*Hfc«w-e«>S3 tr-»962(ciai*tT, u i 

ht. ^\?-wmit*b<ofcmx\ iiLANt- ^<io4 

i^e>y ^=y96ot^uru i #Sil£*u ^$tts 

[0 3 2 9] WAWWilpJIfC^^^ttlSwy^ay 
960iCtt, Ell 0 4O^OJ:p(:f7t^ h^COU 

[0 3 3 0] -CT\ ])*=*^ttt&mmk<Df§\<D=* 
$962 £1" 6) ^l6j»tSo 

® y * = v96o*^*f«ittiatcu i * << 

5>^^^-T6^tw, ^Iffl#^y*3^960<D^:x^ 

® y * ^ >96o i #£»j-r a fc w y ^ ^iftsijft^ 

<D y * =i ^ y * a >-*gtj«« £ u I ^fs-§-5rg it 
utofc>fct*aMirt:, y*3ysKs»jf»a (y^^>A) t 

n&mmz'&mLx^zv— '<\04\\cm. ui© 

1 04 1 «: y * = vssissij it m $ ft 5 y * 3 y 96 

©%\ZZiitz.Uftft t x<o\j 1 ^SttStofcy -^3^960 

fl, U I frmrft'tZ* 

[0 3 3 1] Hi 0 5(1, ^^y^ifi^^ui 
[0 3 3 2] y*3yffi!l<DftL3lO«E^SrSftW"r5 0 xf 

y ys\ 05 1 x\ fUffl#ott33HAff^ h 6 * r-f*»1- 6. 

t?>5^UlS3ftff#t. y^3^g#^su-r6/c 
^0 y * 3 >»jft#^ ^r*^j»ji^*^^ft-eig{f -r 

<5o ^r^ySl053X% ifrj5»e>*»UI**»fll**lft* 
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[o 3 3 3] mi o 6f*. \)*=>&tt%Mmfrt>v i 

[0 3 3 4] ^xy^Sl06lT% y*3^960^t>OS* 
MWJW***- '<1041Ki2HfU U I Oiiff Sr^il-r io 

So 

[0 3 3 5iai07tt, ^^^IIIHUI 
£iE&£ttl&f>1\ i»LAN«*UUIt$tt* 

[0336] *x:y7 p sio7i-c\ *r*«iaA^^ui^ 
*«Bi36» e>**t*o fcy*= ymmm^-r y * a > 

960(C X *f*ttiaiSttSUfll«LA s ^i-«11WU I £36(11- 20 

[0337] mmm3 73 hiosh * 

C0U Ifli«L ANIf— '<104l'rtfc:*>»5 , !J^^^960a 
4> 6 ^ tt960b«r *r*«filT- & 6 F A X 963 |r ft It T . U 

f— s<\04\ frb Jj^3 ^960afo 5 1/ Ml960b(C^t Lt^Jffl 

tiiii/^u i frmmzti, m^ztvzwz^-rmx 
[0 3 3 8] ft&mnizfortx^to^mx-n})**^ 

960a*>6tMi960bl^tt, H 1 0 8 <0^(D <fc b l-T 7* 30 
y960a, 960bt^^iiT-fe6o 

[0 3 3 9] ^CT% %m%ks !/^3>^60a*>6tMi 
960b£ x »fe»aii:OPig^3*a=^--->3^^S: 

y ^r3^960afeS^(±960b^^^mt-(^(t 

960a*>5^fi960b<Z)^y^/^/^ifJJ:«^S o 40 
^960a^> 6 V S*960b g #£§&S'J-f 6 fc#>tf> y * 

3^»j5Uf»a (y-e^^A. y^3> B ) mmmn 

© y * ^ ^960afc 6 1 Ml960bj&> h . ^fflHSUWffi t 
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©f— / < 1 04 112 y * 3 VSttS'JrafRTw $ ix6 V * a > 96 
©ISfS $ tilt. S U t ££lt&o y * 3 >960a 

[0340] jbfE^-m, fijffl«Ksu«ai:UT, y 
fc#* y^=^e>tta.-ip*/£^aL— ^^figijica 

[0 3 4 1] i^^JTliU I fcKoTtftH Lfc^, ft 
[0 3 4 2] HI 0 9(1. y*=»V3iSJ#*««^e>U I 

trsaaaj-tft^-r. ^LAN^^uT^jffi#^i^ 
^sui^sttRfp^. ^i-sw^fejtsy^avffisw 

[0 3 4 3] ^x^ySl09lT% 

6^Ti#t«-6o ^x^ySl092T% MflM^&U I 
afegiJ-T 6 fc*><D y * 3 yK9ffi « <b , *«:»>] 

IzXmm-fZo ^x^yS1094T\ ^it^ofcUI^:, 
[0 3 4 4] Bl 10tt N ^3y^»P)UI 

[0 3 4 5] ^x^ySH0lT\ y^-a^ri^OHsftff 

Iw, g^g*^^mm9Jflr««r^-/<l04l(ci£A 

[0346lHllltts ^^^MilHUI 
^e«S^t>i*, &»LAN*§S&#LTfl|ffi#fcfc£ 

*QfS<O0||^1-7P-^ir-hT-fe5. 0112 
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(0 3 4 7] ^xy^SllllT\ ^Il^bOU I 
[0 3 4 8] iMMPM 3 8] il 1 3, 114(1 B 

m*7F-rmxhz> Q ^<nm<omm%t v*=>>tztMim 

ti y<mU^<Dm^B^Li> 0 

fr£-ti:6o 20 

^t'-mm&xmvm&^nftjtiK fax 
mm-fz>ztnx%te^<DX\ f Ax^zxmf-^ 

©FAX963te^t::&V\ mbtixztcx^f-?* 

^ ztitcmmfaz fax i^ft -r 

[0 3 4 9] ±fS<D#JT\ =3 t°-j&9627^#T-fi*C# 
[0 3 5 0] (HJfc7f^3 9) B115H B<Dm\^h 

zmmmmm t y ^ ^ m^t^ & 6 a £*o 

[0 3 5 1] CCT\ ^lffl#^y^n^<h>fl-^a<tO 40 
P^cO^^^-v'h V^tL^^-r^o TIE 

<nmnxm^hm*&moh<nx\it^\ ©x 

01 1 5T'M^(7)^fc^^I21^UT^6o 
[0 3 5 2] y ^ V960^^HM^fS]ft 

5 0 

<Dy^n^9607i^^Mt^U I mxm^z&zt'i 
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®u i *$^ofcy*3^960tt, u i 6 0 
D;:t y^^960T-n u iS9ftff^£flr^&— 
^rasiaa, *>e^tt-^WIWeui«:a6*J:9*-W: 

^^ttrt^^^n^^r^gjiioffl, u i #&<b*u 

t:^^, S'Mt'UiMm^ 0 z<z>mx 

it* mftmm^xzzi^^-^-i/aisz^xz* 

[o 3 5 3] esi i en. avmzkz&im&mmk 
\)**is<D&q*w$&tofrfozft¥<om&x\ v^r^y 

S1163T\ U I SrSfllUfcA^ p^^y^-T6c *x 
^*y^i-$ 0 *rs/:/Sll65T\ »M^UI^ 

[0354] z<n®^ &{m&mm&mmmmmL 

U I fl> iHLANt- />l04l^y * 3^960^ 
[0 3 5 5] [^W^4 0) ill 1 711 ^lJffi#^fT 

[0356] mft^tm^tctm-Ttisay 
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ffi^Iffl#^$^FAX963^-fey HU *Jffl# (lift 
©FAX963li«^Lfc*SoT^$S:aHi-t*5^* 

(File ABC) tisXQk&-rZ>km^ g*t*ofc*ll 

LT^-T6o to 
[0 3 5 7] Ell 1 8(1. Slffl#*SfTofc»f^-T^-> 

[0 3 5 8] XTyTSUBW* fl|ffl#<Gj^fcffr& s fc 
S*-e»»i"6. ^r^^H82X% *iJffl#asfTofcfc 

;y;/Sll83T\ ^r^f>^U I j&S|6fll$^64-C#ttir 
6 0 *X;/:/SU84T\ git&ofcU I ^-T6o 
[0 3 5 9]01 1 9(1, W8#;Wofc${f • 

[0 3 6 0] ^-r ^^S1191T\ U *3V96Qrt>£><0g3ft 
fa^* s *)5*"e#tt|-t-5o *7^:/Sll92T\ y^yg 
60*^O||3ft{I^^-r6te31S:||fT-r6. Hi 1 7 30 

coa$Ay(^ff-rer^ic^e e ^t^t/si^t-, y^e 

5. 011 7 0>0lj£M&£\ Tom$A/<0^^J; 9. 

ant-*-*. 

[0 3 6 1 ] ®i 2 on. mm%&?T<>tz.fiift-T*i' 40 
B^k. m\k*. ^M^mfrzmwimnkmmm 

k LXteftLXteKMlZjoftZ^ f— /^J^&S^fcfS: 
^f7o-fir- hT*&6 0 01 2 Hi, 

[0 3 6 2] *=ry7S\lQ\X\ W»I^t)(0l*fs 

v^Bi^sm^^m^sr^-r-So 01 1 7<dw<d& 

£\ Tora$^i&f£ft^Lfc:fc§£ File ABC fc LT 
^Lt^5. 50 



[0 3 6 3] Xx^^S1203T\ SH"^ofcVHl-«t 

JS@ffif$R£3E£rt"6. HI l l 7<DM^, Tom£ 
A/3&M996/7/5 10:001^ Afcttf) a S^XtMofcd 
<trt\ ^xy^S1201T^#U/c77^^^*l^ IS 

^^tt6 0 mi 2iftw.%\£titcmm$tWL<nwx-h*>. 

1 996/7/3 (CMary^Fi leXYZ£ lOftS = tf- Lfc 5 3*01 
1996/7/5 10:00l£, Tom£A/#FiIe ABC£Af±<£>a 

x * ^si 204 x\ zt&mmfrb&mifz. y 3 v^su 

[0 3 6 4] (HM^4 1) Ml 22RX*m \ 2 3 
[0 3 6 5] -wT% fJjffl#^ofc^- 7^>3 y 
®y^3^960«, ^t'-mmz.fafa'oX. Tom£A/<D 

<5„ 

ofc®@<D*£U I t LT^t*-^962(r^{It. = f 
H»962fi, :<OU I ^y^^y960iCiIffr6o 

tf>||£\ «^Afibl^ofc^W$>t)fefe-C^{r/jr 

otc(DX\ OtmWfrb r File ABC^A&cOa $A/il 

®3e-ffife962tt. ^IJffl^^O r File ABC^nt°-j 

®U— '<lQ41tt, ^-T6^C# r File ABC J SratT- 
^96211^^0 

®^ t e ~^962li. /<1041^f>S*t«lofcX**RP 

[0 3 6 6] ±Elw4o^T. a— iffl, %<om<F>^ f- 
*962A^!^3|/j!«^S:«i!3ai1-fc«)i^ HE|ot^t> 
r. File ABC^A?±<7)a $^iwiI^ILfcJ Jrl^^Hfc 

ileABCj ^ot^5^i:ft Hl:iUX77^ 

[0 3 6 7] ^fc, ±E-e»i, ©tiaj-r^ts 1 *, fax 

963T-i£fI-f 6 k k fct, f— /<1041t^#LfcXSi: 
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«fc *r£*r* ^ -r 6 c 1 1> x# 6, 

(0 3 6 8] 0124H ^±o3i»2<§-efijffl-r 6 y 
* =i ygeoatt AM ir^f ia*e£>5 0 

[0 3 6 9] minm^xh^o. ttflfc:j:0»M:fif 
Ml-, a*»i24i»c*nfittllliw^ri3?i, 

l242£Jf!^Ttt»£A;&1-Sr*#?£.5 0 

l\ Mic. X4MMMB*ft»l ^V1242-e*t^fc^ 

[0 3 7 0] A;fc£ftfctt«l a«»1243J:9*05« 

(DtcltXDCP U1244£ t t>^s Setttel245j&Mlx.&*VC 

®Wt£X*ffl&*Z>. fE«SR1245fc LTIl SRAM# 
-K. SIMM. HDD^^^rffl^<5rt^-e#6c * 

[0371] 012511 u±<nnmBmxmm-tz> y 

[0 3 7 2] \25\tem^UX*h>9. &£kfoZ> W*CKl\Z 
J:9«*S:ffft5. *^125W^ t^> 3 yi: 

6 0 1252(1 #^V«)|ft^m:9«f«*A*-r5A*» 

*!>OCPU1254£ £t>K. iEt^l255^^^^^tx^ 
9, A^fSa^af&$B1253j&^SfiUfclt*, tftf^«Oia 
mteZZtSm-rZo fEt&gR1255£L-CH SRAM^ 
h\ SIMM. HDD/^^ffl^6^^^t^6 0 
[0 3 7 3] Hi 2 S^y^^Xl IBf|gI51255£&?) 

fM51253£I&»>ftl,TtK m***®. (PC) £LTlsM 
T-#6o Sfc, A*Sl51252$:fc0fl.L,-Ct ) , ^yf/<* 

[0374] 0126H w±<o*jjB^-efi]ffli"-5 y 
[0375] mmm^xh*). mgh^xvm^zft 

1262I1 ^^>^mcJ:«9tt^A^1-6A^ 
*1?<fe<5. Art£*bfci»*ftll ^amSRl263J:9toW 

m<Dtcti>(DC P U1264 1 1 i> td, Sa«l»l265*5fii^ 
T£> D . AaW**#rta««Sl263j&*e>*« LfcifM$> 
tft^®^^«rffi1filt-r5. I£t£2fll255<t LTH SR 
AM#-h\ SIMM. HDD/iMV^rH^T^ 
5. JEfc, PCMCIA^p^/ 1-1266^88:^^^X4319. 01 £ 
(1 PCMCIA^ -MrfSU&Ay-C, PCMCIA'WcJiSttjtt 

0fiftmin&\2Mte%yt\z±z>&ia<D%hX\ smttPCMciA 

^*ftffl-T6J:9^UTt>J:^ 0 t>*>5A,. PCMCIA'* 



[0 3 7 6] ±EHte^ttw«l6*s|| 

bm&tstizi'XTJuizmmvxh. *-<o«i»*»p>/j: 

flSIBOavtra-^ (£fcfiCPU^MPU) fcJ: 

fflsmftfrhmz-m stiff?* m^-KS ft^f^ 

[0 3 7 7] frfrt>7u Vy&zi- K£«&"f 6 & CD f5 
20 tfi&ftfcLTH #!lx.fl 7oyt'-r^^ ^— K 
x-f ftx-fX^. 5fcfi£&x-f*4\ CD-RO 
M. CD-R. ^FWatt©^*!!*— K 

ROMi^i/^ca^flSo 

[0 3 7 8] 3Vtfa.-^*?^tt|Ufc^o^7 
^i-S<5#. ^^t°^-^±T^®)LT^60S (2j--< 

i/vy h^t'tw^m^xmrncommmm^m^m^ 

[0 3 7 9] 3Et^ IEtSii^P>S£^tb$^i:^p^7 
Aa-K^ 3Vlfa-^fcl»A**ifc»IBtt3R#-K 

<D&m \z x o x mm l fc^js^««>ffifcigds||^ $ tt a # 
40 [0380] *nsn«:±s£ttwft^affl-r6»fr. 

[0 3 8 1 ] 

so [H2] %mnm<Dmmffij&£7F-tmxhz> 0 
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[04] |«»»i^^Lf:7P-ft- h 

xh% 0 

[05] It^yy^^, fkm^'J v*£ili*fcb 

[06] V^fl|ffl-r6^^^"r60T'$>6o 
[0 7] x*^T^6£#£i^i^ ^co^u^^ 

[0 8] **^7-^;£f:£I^&^ ^^ri-^m 10 
[09] X^-^^^^^^li^^, X^rtt^fS 

[0io] 

[0ii3 7>v>*<nfcmzm&Tzwr£m\it^i-m 

X&Z> a 20 

[013] 7 7 ^^^gt\ yy^ ] j>^i~6mm 

[014] g{lx-*<D^£»rU ^s^ita^te 
[015] ^»^9(D^S^WI^-r^n-^Y- h 

[0i6] nmem9<D»n<Dffiti*7F'tmvb& 0 

[017] J OBUff^ftl/^Wi^fc-r^n-^^ 30 

[0i8] mfr&t?m®tfim<nffl%7F-T®xbz> e 

[019] 

[02 0] PPWJWindow^«:^i-®T-*>6a 

[02 1] JOB7-^/HDWS:^t@tife5, 

[02 2] <file A>(7)^^^i-0T-J>^ o 

[02 3] ^xJxfc/fcfl^H^fc*. 

[024] m^indo*<Dffl%7f;-tmXhZ) 0 

[02 5] jOBr^^^fiiT^^o 

[02 6] ^^r^oL-zUx — ^<£>#l£^-f0T-&>6 o 40 

[02 7] ^Jffl#^^i^fc-fr(D^Sr^0-efo6o 

[02 8] JOB7-y/^^tHtfc6 0 

[02 9] JOBr-y/KD0!l^^i-0T*fe6o 

[030] :/y v$<n*T-#*<omk<om*7*-rmx 
[031] :/y ^*xr-?xm&mt>-rmxhz> 9 

[03 2] JOBf-^OW^t0tfc5 8 
[03 3] HfflWindow(7)^^^i-®-efe5. 

[034] j 0BT-7/u<Dmz*-rmx'hz> 0 

[03 5] 7"y y^<0^T-^^^fk^^1-|aT- so 
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[03 6] XD/U-Sl'&TfrtffiVh 
[03 7] -fyVBLXTT^^^ v<r»v- jv%7F-rmx*fo 
[03 8] awi^i-sr^^a^Rtfirli^^i- 

[03 9] ^/W^O^o/^^OWSr^-t-ig-e*) 
[04 0] ^T^^W^f-^^^^f^X^ 

[04 1] tftosi»^y vy-t\zm$t$frx^z> 
[042] njg^ie 1 4 (oamzfrb ituxomwm^ 

^i-0T**>6o 
[04 3] 4<Dfti3lW»axS:Sfc>Ufc>>f v 

[04 4] ftfeO^@^$Wi-6^#^^^tt^^h> 
t7o-ft- hT'S)6 0 

[04 5] S^oSB-CAWSrfTi^otea^W^t: 
t^t7D-ft- h"C*>S. 

[04 6] *g^$*ifc:/y v^^n^^^yy >^r-tti 
[04 7] m^^ttfc^y v^^^yy ^y^\c job 
[04 8] ^--ifoyy y^^^-if^^tti^^^y v 

[04 9] IIJE^tfil 6(DAaS^j5lttt*^Lfc7D-^ 

[050] mmmmi s<n$m<D®&mxhz>o 

[051] Xtt&fll 1 7 CO J OB <7^tL£^T0-C£> 

So 

[052] }OB&®WLfe%<o&m<om^*mL 

Ltcyo-^^- bXfoZ> 0 

[053] liso^y >#<D\tthtc*)<Dmmmk 
b-t—mmmzm^tcmxhz, 

[05 4] T'JlyhJOB^^ W#^£L/c 

[055] ^y^h joBg^sg^AaawaaxS:^ 

[056] /!JyhJOB«^ *l]ffl##fl^Lfc 

[057] mmmmi 9©joBoto**t0tfc 
So 

[058] ^!lyhJOBO^^^S:eRfSS:?i| 

[059] 7'i)yhjOB^7>-^r^t^ 

[06 0] Higgle 2 1 O J OB6O^^/^1-0T*fc 
6 0 
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[06 1] ^yyhJOBv/a; ^-i^3>^\ZX6^ 

[06 3] %mwM22<»7y y^^no^D 
[06 4] %m&% 2 zcDwm^mzTF-fy n-^-r- 
[06 5] mmmm2 zo^^^fDmrn^^-rm 

Xfo6 a 10 
[06 6] »12 3^^/«^r>^r 
A^Sff£^Afcti;^1IM£l*L£0Xfc6 o 

[06 7] m+j-^frbx^is^-^ztete-tzmz 

[06 8] H««2 3<D%ftfttefcmmm%7F-t7u 
hX&6 0 

[06 9] ^^^^^M5^-t-^^J^^-r0T*$>eo 

[070] mm&tf&Fiz x v ^xtaoti Ltcm-s 

[07 1] HJfi^li2 4Wft!.3l^«l^1-7D-^^- 20 
hXhZ, 

[072] «»-r5^^^^-/u«:wtt-r6^*^-ria 

Xfc£ 0 

[07 3] I^t6^^^-/u^yy7>^y^ 

ifI*W7D-ft- hX&6 0 

[07 4] si^oy 77V-isy<n^3m%7j<lr7u 
bxhz> 0 

[07 6] %lft&ffi2 e<D^*TJ*±W<D%m<nm^% 30 
ifeUc7o-ft- hX&6 0 
[07 7] AMan^ement&<Dj&m<Dffatl%mt>Ltzy 

[07 8] CoreSPW^aoJEttSr^^Ufc^P-^^- 
hX&6o 

[07 9] ffi^Management^^SWi^n^^^L/cy 
hX&£ D 

[08 0] x-^tttHteao^MgSr^fcUfc^P-^^ 
- hX&6 0 

[08 1 ] T-^WM^i^6tfWf^^t 40 
0X£>6 O 

[08 2] &fe7*ytm^*)&&zm\irz>mxh 

[08 3] Bft^-^^^BgLfc^S^M^^^ 
7o-ft~ hX$>6„ 

[08 4] ***fl2 7 0flr«^»ix*rv1-H-e*>6o 

[08 5] nmj&m2z<n$i&<nmti%K^xhz. 
[08 6] njs^ig2 8<o»aw«tix*^-riar*>-s 0 

[08 7] Sllfi^tB2 8<0ftia^WS*^7o-^^-- 
hX£>6 0 so 



[08 8] H&fc8B^-*<0fc&££:bLfcig?fcS. 
[08 9] iJ/< l-i/{Z®fe£tl1t#W<Dfy&'<--A 

[09o] '&£\zftfrtitcmm*^px&mi.x. &m 

[09 1] »l3 0O«(0l^^f7n-ft 

[09 2] A^Jti^^,ftitfc6 0 

[09 3] ^fAfca-fiOftfiO«t*btfc 

[09 4] ^f)HItt->^rA^Mt/:ffi^J 

[09 5] fi]ffl#fc:Fp i Il^*fcf*L 
ff Lfc^7n-ft- hX*>3« 

[09 6] ^3yia!)^fA«t^ijiii 

[09 7] xv—9x*:-?<DW%7Flr1%vhZ>o 
[098] y^ea^StftWa^rBKu ^t5Ul 

[099] ^ay^iKsau *ttsrsui 

~~ hXfc-5, 

[0ioo] y*a u *tjs-f*u 

-fMr- hX&6 0 

[010 1] u I 

[0102] y*3^*t*»a36^ui«:a»t*D, 

[010 3] y^ny^ii^^ui^t^^ 

[010 4] K3y^ti»f)UI$:I^(tH 

[010 5] D^y^LANf^UUI^ 
^•V- hX&6 0 

[010 6] y^^y^LAN^^uui^ 

^t7D-ft-ht*fc5o 
[010 7] ^^y«LAN^UUI^ 

f7o-ft- hXfc<5 0 
[010 8] y^^y«LAN^^LT^lfS 

[010 9] ^^y«LAN^^lT?llfi 

«©i!il(07ci-fir- hX$>5 0 
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[(Hi 10] K3y«LAN^^LtfHfflfi 

[Ell 1 1] y*3^«j»LAN^*^L-C?Uffl#fe 

[1211 1 2] »*«flli:fiJffl%SffiSUf»«*^^$tuS 
U I ^Lfc^^toi-iaT&S. 

[mi 1 3] s^c$)5iMiii^t/^^ 
imii4] ntDm^hzmmmmmtrntcK^mm 
[igiis] B(nm\zhz> ®tttt&mm t^m^^^^ 

fr-'/a yfytit£fr^tcm&nttfo<DWZ^-rmxh 

So 

[mi i6] mw&i&s 9<Dv^^ym<D^M(Dyu- 
[in 1 7] mm%&ftit:flift'Tti/B mm 

im i i 8] gMj&n* o(D\)^^^m<D!&m<D-7vi- 



[Hi i 9] 9iifi^C4 oo#ft«Bi«o«ya«)7o- 
[mi 20] ntemm4 o<D*-'<m<omk<D7v--T 
[hi 2 ii Hs&r^ixfcjasmao-wsr^-ria-efe 

[01 22] 18E*:5clwtSM^S:fTofcW^i-0T-fe 

[mi 2 3] ®^5r;^^fTo^ii^-rmT-fc 

10 6 0 

[0124] y*=^(D«j«WS:^i-0-C4>6 o 
[12112 5] y*3yeO*fife0i|*:^i-®-C«>S. 
[Ill 2 6] \)**y<Oft!$W%ifrrmX~hZ 0 
[01 2 7] *^ii^S:fT9^if5^m^L,fc««Sr 

[Si 2 8] JOB<DBftfc£Cfc£«##&Lfc^» 

[1129] M^feS:^— ^l-«^*t*6^^>K^ 

[mi 3 0] ^^^-^^i^n-sx^jw^fc-rE 
TFLtcmx-hZo 



in 
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